-- Logs begin at Thu 2022-06-23 16:13:44 UTC, end at Thu 2022-06-23 17:41:20 UTC. -- Jun 23 16:58:03.043373 dv-cinder-835384-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 16:58:03 2022] *** Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: nodename: dv-cinder-835384-10-iscsi Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: machine: x86_64 Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: clock source: unix Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: pcre jit disabled Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: detected number of CPU cores: 4 Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: current working directory: / Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: detected binary path: /usr/bin/uwsgi-core Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: your processes number limit is 47680 Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: your memory page size is 4096 bytes Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: detected max file descriptor number: 2048 Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: lock engine: pthread robust mutexes Jun 23 16:58:03.055341 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: thunder lock: enabled Jun 23 16:58:03.057263 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 16:58:03.057263 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 16:58:03.103742 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: Python main interpreter initialized at 0x55603567d9c0 Jun 23 16:58:03.103742 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: python threads support enabled Jun 23 16:58:03.103742 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: your server socket listen backlog is limited to 100 connections Jun 23 16:58:03.103742 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: your mercy for graceful operations on workers is 90 seconds Jun 23 16:58:03.104067 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 16:58:03.104143 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: *** Operational MODE: preforking *** Jun 23 16:58:03.104427 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: *** uWSGI is running in multiple interpreter mode *** Jun 23 16:58:03.104427 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: spawned uWSGI master process (pid: 80406) Jun 23 16:58:03.104621 dv-cinder-835384-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 23 16:58:03.105820 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: spawned uWSGI worker 1 (pid: 80414, cores: 1) Jun 23 16:58:03.105820 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: spawned uWSGI worker 2 (pid: 80415, cores: 1) Jun 23 16:58:03.105820 dv-cinder-835384-10-iscsi devstack@keystone.service[80406]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 16:58:08.483508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 16:58:08.483508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: from cryptography.utils import int_from_bytes Jun 23 16:58:08.484433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 16:58:08.484433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: from cryptography.utils import int_from_bytes Jun 23 16:58:08.484859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 16:58:08.484859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: from cryptography.utils import int_from_bytes Jun 23 16:58:08.484970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 16:58:08.484970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: from cryptography.utils import int_from_bytes Jun 23 16:58:08.532091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 16:58:08.532283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 16:58:08.532369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 16:58:08.532451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 16:58:08.532514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] command line args: [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 16:58:08.532583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] command line args: [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 16:58:08.532735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 16:58:08.532817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 16:58:08.532887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ================================================================================ {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 16:58:08.532957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ================================================================================ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 16:58:08.533091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] admin_token = **** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] admin_token = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] config_dir = [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_dir = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533644 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] config_source = [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_source = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533870 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] debug = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.533944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] debug = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.534107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.534345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.534433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.534501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.534625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.534700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.534882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535009 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535136 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535334 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] list_limit = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_config_append = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] log_config_append = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_dir = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] log_dir = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.535950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] log_file = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.536141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.536247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.536349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.536437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.536499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.536693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.536816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.536942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.537073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.537192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.537276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.537467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.537614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.537776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.537916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.537916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.538989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.539108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.539184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.539310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.539387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.539502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.539902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] publish_errors = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] publish_errors = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.540985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] standard_threads = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] standard_threads = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.541994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] use_journal = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_journal = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] use_json = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542378 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_json = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] use_stderr = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_stderr = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] use_syslog = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542681 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_syslog = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.542870 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.543004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:58:08.543091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.543179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.543345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.543479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.543569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.543642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.543827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.543969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.544969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.545043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.545227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.545365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.545447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.545526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.545692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.545865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.545950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.546968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.547110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.547201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.547360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.547448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.547596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.547677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.547831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.547922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.548079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.548169 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.548334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.548416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.548583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.548664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.548830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.548920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.549053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.549142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.549280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.549362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.549504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.549594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.549730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.549834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550096 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.550921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551394 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551861 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.551946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.552093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.552173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.552323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.552402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.552535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.552616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.552759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.552838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.553097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.553231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.553305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.553550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.553686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.553860 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.553997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.554892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.555028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.555139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.555266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.555368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.555571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.555696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.555836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.555997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.556132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.556255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.556377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.556499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.556620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.556741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.556886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.557010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.557134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.557255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.557376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.557513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.557650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.557781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.557930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.558065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.558196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.558316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.558438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.558570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.558707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.558837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.558957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.559080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.559214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.559349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.559481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.559603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.559742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.559867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.559989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.560110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.560244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.560368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.560497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.560633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.560759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.560883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.561024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.561150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.561278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.561408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.561547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.561681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.561852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.561981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.562107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.562239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.562363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.562496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.562629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.562757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.562894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.563017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.563140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.563282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.563406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.563535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.563659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.563781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.563906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.564041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.564166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.564290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.564419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.564554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.564684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.564895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.565028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.565153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.565276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.565400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.565523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.565654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.565806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.565944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.566075 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.566198 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.566322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.566457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.566588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.566720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.566851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.566974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.567099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.567228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.567353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.567488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.567613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.567737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.567860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.568254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.568380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.568532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.568726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.568823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.568946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.569023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.569084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.569279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] auth.external = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.569420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.569549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.569674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.external = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.569848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.569986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.570141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.570289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.570425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] auth.password = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.570551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.570678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] auth.token = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.570803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.password = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.570926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.571058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.token = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.571189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.571189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.571425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.571550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.571675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.571807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.571943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.572080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.572205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.572330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.572460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.572594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] credential.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.572720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.572845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.572969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.573094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.573225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.573489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.573615 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.573765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.573908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.574032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.574169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.574297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.574425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.574551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.574677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.574804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.574945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.575073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.575208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.575336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.575463 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.575603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.575739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.575867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.575994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.576121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.576248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.576374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.576509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.576637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.576764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] federation.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.576891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.577017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.577144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.577654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.577839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.577966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.578094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.578226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.578351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.578486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.578612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.578737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.578861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.578987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.579116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.579248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.579374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.579511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.579636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.579762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.579892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.580027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.580153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.580276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.580407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.580532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.580655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.580865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.580993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.581120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.581245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.581388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.581513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.581646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.581774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.581919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.582046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.582173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.582307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.582435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.582561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.582685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.582809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.582933 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.583073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.583201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.583325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.583453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.583579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.583703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.583835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.583961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.584084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.584355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.584491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.584703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.584784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.584926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.585063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.585189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.585314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.585439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.585573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.585699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.585843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.585966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.586091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.586218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.586356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.586482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.586606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.586740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.586865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.586989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.587122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.587247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.587373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.587498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.587622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.587817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.587955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.588083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.588209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.588333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.588457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.588591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.588725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.588850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.588975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.589099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.589229 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.589354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.589491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.589623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.589759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.589931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.590053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.590177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.590322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.590454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.590579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.590702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.590834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.590966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.591100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.591225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.591348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.591473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.591599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.591722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.591847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.591974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.592109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.592233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.592358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.592483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.592616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.592741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.592864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.592987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.593112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.593236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.593367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.593497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.593623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.593767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.593948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.594082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.594218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.594344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.594468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.594592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.594716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.594840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.594972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.595097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.595229 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.595355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.595481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.595624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.595753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.595877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.596002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.596126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.596253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.596385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.596510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.596635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.596761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.596885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.597009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.597141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.597267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.597401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.597526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.597649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.597772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.597923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.598092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.598218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.598347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.598476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.598603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.598738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.598867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.598993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.599118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.599256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.599384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.599519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.599646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.599775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.599908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.599992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600143 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600548 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.600937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.601067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.601190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.601317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.601444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.601582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.601710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.601890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.602015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.602140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.602263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.602402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.602540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.602666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.602791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.602915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.603040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.603171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] resource.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.603297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.603425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.603550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.603675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.603800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.603932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.604009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.604120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.604258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.604385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.604510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.604643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.604768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.604893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.605017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.605141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.605265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.605462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.605590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.605715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] role.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.605856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.605982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] role.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.606115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.606252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.606376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.606500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.606622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.606745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.606874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.607007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.607131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.607131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.607370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.607496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.607619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.607760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.607884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.608008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.608131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.608256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.608387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.608511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.608633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.608762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.608886 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.609009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.609140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.609265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.609398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.609522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.609646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.609769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.609769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.610045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.610045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.610281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.610406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.610531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.610662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.610787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.610912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.611050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.611175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.611300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.611434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.611560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.611683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.611807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.611932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.612057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.612188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.612313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.612438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.612561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.612695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.612819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.612951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.613077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.613202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.613331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.613457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.613620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.613748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.614021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.614146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.614274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.614400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.614539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.614677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.614802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.614926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] token.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.615894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.616121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.616249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.616387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.616514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.616640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.616774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.616942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.617063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.617188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.617312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.617436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.617567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.617692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.617861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.617988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.618125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.618250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.618386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.618514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.618638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.618765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.618888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.619015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.619148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.619275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.619399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.619525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.connection = **** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.619660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.619795 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.619932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.620068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.620203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.620336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.620464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.620589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.620713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.620839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.620965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.621099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.621225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.621350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.621476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.621601 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.621740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.621921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.622046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.622175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.622304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.622431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.622558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.622693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.622821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.622949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.623076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.623204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.623335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.623469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.623605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.623733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.623817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.623959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.624086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.624223 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.624352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.624478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 16:58:08.624606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:58:08.624606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 16:58:08.646662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.646889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.647011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.647202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.647278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.647486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.655990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.656080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.683970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.684235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.684614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.684916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.827745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.828448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.876080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.876316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.876413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.876542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.939890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.940971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.941038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966326 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.966887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.967037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.967162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.967297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.967391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.967501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.978376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.978689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.991003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.991226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.991446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.991573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.991708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.991787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.991865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.991940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.992047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.992137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.992278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.992403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.992554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:08.992676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 16:58:09.009979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.010141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.010277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 16:58:09.010388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 16:58:09.010511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.010592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.010698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 16:58:09.010787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 16:58:09.010993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.011131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.011267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.011348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.011494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.011621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.011770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.011853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.022576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.022703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.022822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.022906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.023098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.023222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.023358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.023440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.031674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.031819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.034975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.035101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.035221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.035304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.035510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.035635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.035764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.035848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.036049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.036174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.036316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.036402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.036552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.036676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.036812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.036906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.037060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.037153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.037354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.037633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.037761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.037970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.063922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.064200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.065547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.065819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.065972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.066130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.071182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.071508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.071632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.071803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.071934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.072159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.079509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.079734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.079883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.080016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.084399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.084571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.084657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.084736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.085049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.085175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.085329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.085461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.085582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.085715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.085853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.085983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.086097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.086176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.086431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.086699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.104800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.105097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.105449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.105723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.109765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.110390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.113688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.114045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.114213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.114424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.119134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.119552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.122921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.123154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.126594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.126827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.126925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.127125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.127217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.127397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.127489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.127671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.127760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.127967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.128158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.128255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.147095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.147300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.147398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.147598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.147691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.147864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.147955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.148151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.155745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.156012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.157454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.157726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.157925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.158020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.160960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.161165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.161265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.161408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.161623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.161761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.161886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.161957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.162198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.162328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.175419 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.175547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.175653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.175864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.175992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.176195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.176324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.176462 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.177884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.178088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.178184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.178575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.178698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.178933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.196247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.196714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.199541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.200027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.203202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.203699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.204925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.205425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.206587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.206861 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.207112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.207246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.207405 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.207657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.214467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.215046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.216054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.216643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.219255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.219540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.219876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.220004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.220174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.220369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.220533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.220806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.229312 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.229598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.229895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.230021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.230178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.230449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.237700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.238004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.238281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.238407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 16:58:09.238559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.238691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.238818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.238996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.239088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.239210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.239334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.239512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.239654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.239785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.239912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.240048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.240227 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.240358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.240549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.240675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.240814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.240983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.241114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.241245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.241373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.241502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.241652 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.241854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 16:58:09.278966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55603567d9c0 pid: 80414 (default app) Jun 23 16:58:09.279763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55603567d9c0 pid: 80415 (default app) Jun 23 16:58:09.282414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de16cb-8fce-442a-87b5-d0141405225e None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:09.282711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de16cb-8fce-442a-87b5-d0141405225e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:09.282986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de16cb-8fce-442a-87b5-d0141405225e None None] PATH_INFO: `/v3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:09.287289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Thu Jun 23 16:58:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:17.029513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee1ad-c1a0-47ee-ba51-4b1cd634fba1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:17.030456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee1ad-c1a0-47ee-ba51-4b1cd634fba1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:17.030456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee1ad-c1a0-47ee-ba51-4b1cd634fba1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:17.037307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:17.044882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:17.045322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:17.045412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:17.123404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: INFO dbcounter [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] Registered counter for database keystone Jun 23 16:58:17.147912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:58:17.159961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writer thread running {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:58:17.342240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG passlib.handlers.bcrypt [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80414) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 16:58:17.342554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG passlib.handlers.bcrypt [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80414) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 16:58:17.398326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:17.399947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:17.553164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 16:58:17.714421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee1ad-c1a0-47ee-ba51-4b1cd634fba1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:17.785589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: INFO dbcounter [None req-25dee1ad-c1a0-47ee-ba51-4b1cd634fba1 None None] Registered counter for database keystone Jun 23 16:58:17.807619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG oslo_db.sqlalchemy.engines [None req-25dee1ad-c1a0-47ee-ba51-4b1cd634fba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:58:17.819546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writer thread running {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:58:17.938905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee1ad-c1a0-47ee-ba51-4b1cd634fba1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:17.944577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f694d1-9079-4873-9d48-0e3cc98b7b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:17.945197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f694d1-9079-4873-9d48-0e3cc98b7b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:17.945477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f694d1-9079-4873-9d48-0e3cc98b7b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:17.945750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f694d1-9079-4873-9d48-0e3cc98b7b48 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:17.955263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f694d1-9079-4873-9d48-0e3cc98b7b48 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:18.006863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d0f694d1-9079-4873-9d48-0e3cc98b7b48 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 16:58:18.007202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f694d1-9079-4873-9d48-0e3cc98b7b48 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:18.017596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Jun 23 16:58:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 16:58:18.027778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:18.047139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bafe9-33ff-4191-8a4b-40e88e569c36 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:18.053372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb54748-c2cb-4aba-a9de-46ee57f9a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:18.054526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54748-c2cb-4aba-a9de-46ee57f9a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:18.054805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54748-c2cb-4aba-a9de-46ee57f9a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:18.055075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54748-c2cb-4aba-a9de-46ee57f9a2ee admin admin] PATH_INFO: `/v3/projects/817b32abe9534b1196adc7d371e17f3c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:18.056826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb54748-c2cb-4aba-a9de-46ee57f9a2ee admin admin] RBAC: Authorizing `identity:get_project(project_id=817b32abe9534b1196adc7d371e17f3c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:18.111050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5eb54748-c2cb-4aba-a9de-46ee57f9a2ee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 16:58:18.111368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb54748-c2cb-4aba-a9de-46ee57f9a2ee admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:18.116163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Jun 23 16:58:18 2022] GET /identity/v3/projects/817b32abe9534b1196adc7d371e17f3c => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:20.159428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc6d43-c19e-41f8-b621-df4a06795fdd None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:20.160303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc6d43-c19e-41f8-b621-df4a06795fdd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:20.160303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc6d43-c19e-41f8-b621-df4a06795fdd None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:20.165458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:20.172197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26448895-c78d-4b46-a86f-44c528c6585e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:20.172640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26448895-c78d-4b46-a86f-44c528c6585e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:20.172761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26448895-c78d-4b46-a86f-44c528c6585e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:20.200479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-26448895-c78d-4b46-a86f-44c528c6585e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:20.202036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-26448895-c78d-4b46-a86f-44c528c6585e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:20.211577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 16:58:20.234589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc6d43-c19e-41f8-b621-df4a06795fdd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:20.257205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc6d43-c19e-41f8-b621-df4a06795fdd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:20.262773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568481-656c-4508-bac0-633eff3631c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:20.263414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568481-656c-4508-bac0-633eff3631c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:20.263702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568481-656c-4508-bac0-633eff3631c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:20.263984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568481-656c-4508-bac0-633eff3631c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:20.272614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568481-656c-4508-bac0-633eff3631c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:20.274476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568481-656c-4508-bac0-633eff3631c6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:20.283294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Jun 23 16:58:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 16:58:20.289552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26448895-c78d-4b46-a86f-44c528c6585e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:20.304776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26448895-c78d-4b46-a86f-44c528c6585e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:20.314238 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543dad0-5b95-4074-b240-19f4ea7396d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:20.315581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543dad0-5b95-4074-b240-19f4ea7396d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:20.315992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543dad0-5b95-4074-b240-19f4ea7396d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:20.316392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543dad0-5b95-4074-b240-19f4ea7396d3 admin admin] PATH_INFO: `/v3/users/6aa38b5acec04d4fa14aadd10b58f34f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:20.318995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543dad0-5b95-4074-b240-19f4ea7396d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=6aa38b5acec04d4fa14aadd10b58f34f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:20.320844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543dad0-5b95-4074-b240-19f4ea7396d3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:20.322422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Thu Jun 23 16:58:20 2022] GET /identity/v3/users/6aa38b5acec04d4fa14aadd10b58f34f => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:22.394808 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5b651-02c0-48e4-a046-334b8ef51d15 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:22.395358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5b651-02c0-48e4-a046-334b8ef51d15 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:22.395358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5b651-02c0-48e4-a046-334b8ef51d15 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:22.396693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:22.402206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086a5eb-7371-4870-8a10-1ef466ad32f9 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:22.402634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086a5eb-7371-4870-8a10-1ef466ad32f9 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:22.402716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086a5eb-7371-4870-8a10-1ef466ad32f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:22.420480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4086a5eb-7371-4870-8a10-1ef466ad32f9 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:22.421694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4086a5eb-7371-4870-8a10-1ef466ad32f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:22.477752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac05268-cce5-43c6-a18a-52eb47dd3e59 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:22.478180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac05268-cce5-43c6-a18a-52eb47dd3e59 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:22.478521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac05268-cce5-43c6-a18a-52eb47dd3e59 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:22.479930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:22.485209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:22.485492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:22.485767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:22.505717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:22.528131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG passlib.handlers.bcrypt [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80415) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 16:58:22.528558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG passlib.handlers.bcrypt [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80415) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 16:58:22.528715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086a5eb-7371-4870-8a10-1ef466ad32f9 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:22.553355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:22.575192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:22.576846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:22.641442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086a5eb-7371-4870-8a10-1ef466ad32f9 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:22.678457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490967-83c5-4bff-aefd-84fa810bdef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:22.679185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490967-83c5-4bff-aefd-84fa810bdef0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:22.679462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490967-83c5-4bff-aefd-84fa810bdef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:22.679732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70490967-83c5-4bff-aefd-84fa810bdef0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:22.684427 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:22.694614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70490967-83c5-4bff-aefd-84fa810bdef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:22.705423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-70490967-83c5-4bff-aefd-84fa810bdef0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:22.706512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:22.707626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:22.708611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:58:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:58:22.715525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490967-83c5-4bff-aefd-84fa810bdef0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:22.797310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:22.808406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67783100-79ac-45e6-a02a-606dfc4c19de None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:22.811471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:22.816785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70490967-83c5-4bff-aefd-84fa810bdef0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:22.846166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c2b0-5cdc-4ce4-9b62-7f4150247579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:22.847074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c2b0-5cdc-4ce4-9b62-7f4150247579 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:22.847356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c2b0-5cdc-4ce4-9b62-7f4150247579 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:22.847636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c2b0-5cdc-4ce4-9b62-7f4150247579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:22.850527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:22.851197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:22.851481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:22.851754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:22.852516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:22.852822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:22.854283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:22.866063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:22.871713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:22.915722 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c2b0-5cdc-4ce4-9b62-7f4150247579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:22.917257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c2b0-5cdc-4ce4-9b62-7f4150247579 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:22.975577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e17f93-a634-44ce-a31d-1f1e53453c39 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:23.008643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c477-2cfc-4123-9415-9e127810fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:23.009520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c477-2cfc-4123-9415-9e127810fc96 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:23.009812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c477-2cfc-4123-9415-9e127810fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:23.010092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c477-2cfc-4123-9415-9e127810fc96 None admin] PATH_INFO: `/v3/users/6aa38b5acec04d4fa14aadd10b58f34f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:23.011271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3c477-2cfc-4123-9415-9e127810fc96 None admin] RBAC: Authorizing `identity:get_user(user_id=6aa38b5acec04d4fa14aadd10b58f34f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:23.012723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3c477-2cfc-4123-9415-9e127810fc96 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:23.013436 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:23.014522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:22 2022] GET /identity/v3/users/6aa38b5acec04d4fa14aadd10b58f34f => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:23.019275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c2b0-5cdc-4ce4-9b62-7f4150247579 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:23.019559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c477-2cfc-4123-9415-9e127810fc96 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:23.022183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:23.034568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:23.116852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c2b0-5cdc-4ce4-9b62-7f4150247579 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:23.118333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c477-2cfc-4123-9415-9e127810fc96 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:23.150455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:23.151249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:23.151528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:23.151795 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:23.152077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2597830-dce4-4072-8c30-643b94df4d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:23.152878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2597830-dce4-4072-8c30-643b94df4d18 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:23.153159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2597830-dce4-4072-8c30-643b94df4d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:23.153434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2597830-dce4-4072-8c30-643b94df4d18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:23.154685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2597830-dce4-4072-8c30-643b94df4d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:23.156126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2597830-dce4-4072-8c30-643b94df4d18 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:23.157737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:23.163648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2597830-dce4-4072-8c30-643b94df4d18 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:23.171448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:23.172932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:58:23.193208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:23.194304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:23.195310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:58:23.195310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:58:23.195310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:58:23.195310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:23.195310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:58:23.200502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:23.247099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:23.259712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:23.268356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2597830-dce4-4072-8c30-643b94df4d18 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:23.302093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457a4e-8a56-4b03-994e-d40098de71de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:23.302776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457a4e-8a56-4b03-994e-d40098de71de None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:23.303063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457a4e-8a56-4b03-994e-d40098de71de None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:23.303341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457a4e-8a56-4b03-994e-d40098de71de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:23.304180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457a4e-8a56-4b03-994e-d40098de71de None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.domain.id=default, user.id=6aa38b5acec04d4fa14aadd10b58f34f) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:23.304493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457a4e-8a56-4b03-994e-d40098de71de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:23.304782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10088da-fd1a-4f6a-96af-81238bc1fda6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:23.305994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457a4e-8a56-4b03-994e-d40098de71de None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:23.312786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Jun 23 16:58:23 2022] GET /identity/v3/role_assignments?user.id=6aa38b5acec04d4fa14aadd10b58f34f&scope.domain.id=default&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:23.342168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99e3bc-56e3-480c-bdf2-ff3997e37d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:23.342853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99e3bc-56e3-480c-bdf2-ff3997e37d58 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:23.343131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99e3bc-56e3-480c-bdf2-ff3997e37d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:23.343403 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99e3bc-56e3-480c-bdf2-ff3997e37d58 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:23.344149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99e3bc-56e3-480c-bdf2-ff3997e37d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:23.344456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99e3bc-56e3-480c-bdf2-ff3997e37d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:23.345919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99e3bc-56e3-480c-bdf2-ff3997e37d58 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:23.367117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:25.741035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23373c7e-ba56-408e-88f8-700998938b27 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:25.742160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23373c7e-ba56-408e-88f8-700998938b27 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:25.742646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23373c7e-ba56-408e-88f8-700998938b27 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:25.744232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:25.759702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e99a2-22b8-4ea9-9b54-394767350039 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:25.760594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e99a2-22b8-4ea9-9b54-394767350039 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:25.761087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e99a2-22b8-4ea9-9b54-394767350039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:25.783256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ea1e99a2-22b8-4ea9-9b54-394767350039 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:25.784801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ea1e99a2-22b8-4ea9-9b54-394767350039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:25.872355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:25.896741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c433-9448-42f8-b292-a7181c90de14 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:25.897383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c433-9448-42f8-b292-a7181c90de14 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:25.897872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c433-9448-42f8-b292-a7181c90de14 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:25.899449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:25.904838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc1e32-d9f7-46f4-91aa-7b5fdf8e9842 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:25.905369 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc1e32-d9f7-46f4-91aa-7b5fdf8e9842 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:25.905860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc1e32-d9f7-46f4-91aa-7b5fdf8e9842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:25.928190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722c433-9448-42f8-b292-a7181c90de14 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:25.938255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b2fc1e32-d9f7-46f4-91aa-7b5fdf8e9842 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:25.941702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b2fc1e32-d9f7-46f4-91aa-7b5fdf8e9842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:26.021280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:26.072320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 12/25] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:26.075206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3688-2194-4348-9c01-79b37503753f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:26.075870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3688-2194-4348-9c01-79b37503753f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:26.078018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f3688-2194-4348-9c01-79b37503753f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:26.079729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:26.087707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c987-7a4c-4fc6-8468-23f04d89487f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:26.088576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c987-7a4c-4fc6-8468-23f04d89487f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:26.089277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c987-7a4c-4fc6-8468-23f04d89487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:26.121566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b991c987-7a4c-4fc6-8468-23f04d89487f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:26.124461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b991c987-7a4c-4fc6-8468-23f04d89487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:26.148771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722c433-9448-42f8-b292-a7181c90de14 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:26.218757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404e2bd-1a1a-4d3c-a090-2b303f629e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:26.219422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404e2bd-1a1a-4d3c-a090-2b303f629e3a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:26.219708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404e2bd-1a1a-4d3c-a090-2b303f629e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:26.219982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404e2bd-1a1a-4d3c-a090-2b303f629e3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:26.232578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:26.234080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c987-7a4c-4fc6-8468-23f04d89487f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:26.246208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404e2bd-1a1a-4d3c-a090-2b303f629e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-d404e2bd-1a1a-4d3c-a090-2b303f629e3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:26.258004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:26.258948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:26.259722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 14/28] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:26.268800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404e2bd-1a1a-4d3c-a090-2b303f629e3a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:26.278045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:26.359566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c987-7a4c-4fc6-8468-23f04d89487f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:26.369276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:26.402027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96974-5922-410d-bc72-271f05a50198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:26.403161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96974-5922-410d-bc72-271f05a50198 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:26.403636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96974-5922-410d-bc72-271f05a50198 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:26.404118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96974-5922-410d-bc72-271f05a50198 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:26.405069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c96974-5922-410d-bc72-271f05a50198 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:26.406711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c96974-5922-410d-bc72-271f05a50198 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:26.470063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404e2bd-1a1a-4d3c-a090-2b303f629e3a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:26.514668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79ec9-8c10-42dd-87e0-109e761d4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:26.515791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79ec9-8c10-42dd-87e0-109e761d4526 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:26.516294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79ec9-8c10-42dd-87e0-109e761d4526 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:26.516787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79ec9-8c10-42dd-87e0-109e761d4526 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:26.518130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79ec9-8c10-42dd-87e0-109e761d4526 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:26.520174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79ec9-8c10-42dd-87e0-109e761d4526 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:26.562233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 15/29] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 23 16:58:26 2022] POST /identity/v3/roles => generated 219 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:26.563723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96974-5922-410d-bc72-271f05a50198 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:26.696816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 15/30] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 23 16:58:26 2022] POST /identity/v3/roles => generated 225 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:58:26.700381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997505d8-0cbc-4057-80fc-95cd2ffa8195 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:26.703509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997505d8-0cbc-4057-80fc-95cd2ffa8195 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:26.704082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997505d8-0cbc-4057-80fc-95cd2ffa8195 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:26.706689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 16/31] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:26.714127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070860c-ed07-49d4-befa-04a97d2e0fa0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:26.714778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070860c-ed07-49d4-befa-04a97d2e0fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:26.715280 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070860c-ed07-49d4-befa-04a97d2e0fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:26.759983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9070860c-ed07-49d4-befa-04a97d2e0fa0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:26.764045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9070860c-ed07-49d4-befa-04a97d2e0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:26.852638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c96974-5922-410d-bc72-271f05a50198 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:26.938511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:26.957895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 17/32] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:26.963902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:26.964900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:26.965185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:26.965474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:26.966273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:26.966581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:26.968138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:26.986051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 16/33] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:26.989212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070860c-ed07-49d4-befa-04a97d2e0fa0 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:26.992996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:27.040025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:27.138882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070860c-ed07-49d4-befa-04a97d2e0fa0 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:27.151269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9426c3-aa64-44ab-a668-be4789a918c0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:27.177887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:27.178700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.178981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.179257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.187776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4a0ae-c0be-4a1d-9314-e5abcb995e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:27.188528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4a0ae-c0be-4a1d-9314-e5abcb995e3f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.188815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4a0ae-c0be-4a1d-9314-e5abcb995e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.189106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4a0ae-c0be-4a1d-9314-e5abcb995e3f None admin] PATH_INFO: `/v3/users/6aa38b5acec04d4fa14aadd10b58f34f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.190056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:27.190797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4a0ae-c0be-4a1d-9314-e5abcb995e3f None admin] RBAC: Authorizing `identity:get_user(user_id=6aa38b5acec04d4fa14aadd10b58f34f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:27.191682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:27.192245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4a0ae-c0be-4a1d-9314-e5abcb995e3f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:27.194695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:26 2022] GET /identity/v3/users/6aa38b5acec04d4fa14aadd10b58f34f => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:27.195550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1da5f-64f0-457c-bf7f-5e5deae1e487 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.195934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1da5f-64f0-457c-bf7f-5e5deae1e487 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.196218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1da5f-64f0-457c-bf7f-5e5deae1e487 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.197836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 18/35] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:27.203157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe155b-b447-47f4-aff9-e166014c31d4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.203444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe155b-b447-47f4-aff9-e166014c31d4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.203721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe155b-b447-47f4-aff9-e166014c31d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:58:27.216466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:27.217323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:27.218193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:58:27.218193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:58:27.218193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:58:27.218193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:27.218193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:27.219054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:27.226885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-17fe155b-b447-47f4-aff9-e166014c31d4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:27.228430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-17fe155b-b447-47f4-aff9-e166014c31d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:27.275042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:27.309908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:27.309908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe155b-b447-47f4-aff9-e166014c31d4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:27.333613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:27.347105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158bd71-d0ee-47c8-a9ff-41a2cd3b4c87 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:27.394264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52df22-bdae-4bb2-b641-eac38bc309c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:27.395178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52df22-bdae-4bb2-b641-eac38bc309c3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.395648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52df22-bdae-4bb2-b641-eac38bc309c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.396083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52df22-bdae-4bb2-b641-eac38bc309c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.397929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52df22-bdae-4bb2-b641-eac38bc309c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:27.399398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52df22-bdae-4bb2-b641-eac38bc309c3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:27.401065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:27.401830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52df22-bdae-4bb2-b641-eac38bc309c3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:27.418654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe155b-b447-47f4-aff9-e166014c31d4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:27.459465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:27.460165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.460455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.460737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.461475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:27.461782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:27.463245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:27.474948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 20/39] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:27.479837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:27.515709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52df22-bdae-4bb2-b641-eac38bc309c3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:27.531741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:27.552247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9224fd2-94b3-45f8-8687-824265ec67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:27.552955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9224fd2-94b3-45f8-8687-824265ec67bb None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.553415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9224fd2-94b3-45f8-8687-824265ec67bb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.553512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9224fd2-94b3-45f8-8687-824265ec67bb None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.554269 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9224fd2-94b3-45f8-8687-824265ec67bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:27.555670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9224fd2-94b3-45f8-8687-824265ec67bb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:27.561691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:27.569575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 23 16:58:27 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:27.571080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62d6f-1c11-40c8-be17-2343a47cd2dd None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.571470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62d6f-1c11-40c8-be17-2343a47cd2dd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.571756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c62d6f-1c11-40c8-be17-2343a47cd2dd None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.573053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 21/41] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:27.581281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c62d6f-1c11-40c8-be17-2343a47cd2dd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:27.588200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e1004-5389-4468-9b2b-3ea26c839238 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:27.634746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d01cdd-8324-4cc4-829e-14df77f4020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:27.635726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01cdd-8324-4cc4-829e-14df77f4020d None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.636066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01cdd-8324-4cc4-829e-14df77f4020d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.636406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01cdd-8324-4cc4-829e-14df77f4020d None admin] PATH_INFO: `/v3/domains/default/users/6aa38b5acec04d4fa14aadd10b58f34f/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.638869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d01cdd-8324-4cc4-829e-14df77f4020d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6aa38b5acec04d4fa14aadd10b58f34f, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:27.640518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d01cdd-8324-4cc4-829e-14df77f4020d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:27.662396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1361 bytes} [Thu Jun 23 16:58:27 2022] PUT /identity/v3/domains/default/users/6aa38b5acec04d4fa14aadd10b58f34f/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:58:27.665041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2dc4-e127-45b5-b11c-1123d4250bb9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.665663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2dc4-e127-45b5-b11c-1123d4250bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.666202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2dc4-e127-45b5-b11c-1123d4250bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.687979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b21f2dc4-e127-45b5-b11c-1123d4250bb9 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:27.689770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b21f2dc4-e127-45b5-b11c-1123d4250bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:27.782649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:27.806947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f2dc4-e127-45b5-b11c-1123d4250bb9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:27.855237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c62d6f-1c11-40c8-be17-2343a47cd2dd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:27.892543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660b14-a7b6-4251-95d0-9136f724e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:27.893235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660b14-a7b6-4251-95d0-9136f724e3a5 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.893528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660b14-a7b6-4251-95d0-9136f724e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.893832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660b14-a7b6-4251-95d0-9136f724e3a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.894571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf660b14-a7b6-4251-95d0-9136f724e3a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:27.896064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf660b14-a7b6-4251-95d0-9136f724e3a5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:27.905159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:27.930781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 16:58:27 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:27.933269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f2dc4-e127-45b5-b11c-1123d4250bb9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:27.975232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582b0d2-4cd7-494a-8c17-bd9b3f525e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:27.976231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582b0d2-4cd7-494a-8c17-bd9b3f525e9a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:27.976514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582b0d2-4cd7-494a-8c17-bd9b3f525e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:27.976786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582b0d2-4cd7-494a-8c17-bd9b3f525e9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:27.978052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582b0d2-4cd7-494a-8c17-bd9b3f525e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:27.979558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582b0d2-4cd7-494a-8c17-bd9b3f525e9a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:27.981480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 23/45] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:27.987299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660b14-a7b6-4251-95d0-9136f724e3a5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:28.019059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:28.108409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660b14-a7b6-4251-95d0-9136f724e3a5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:28.144079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2d4cb-f19f-4caa-9a57-97f807d16758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:28.144736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2d4cb-f19f-4caa-9a57-97f807d16758 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:28.145021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2d4cb-f19f-4caa-9a57-97f807d16758 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:28.145301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2d4cb-f19f-4caa-9a57-97f807d16758 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:28.146070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2d4cb-f19f-4caa-9a57-97f807d16758 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:28.147770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2d4cb-f19f-4caa-9a57-97f807d16758 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:28.175039 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 16:58:27 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:29.716502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88e607-5742-4ec2-974e-fe68d1546411 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:29.717009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88e607-5742-4ec2-974e-fe68d1546411 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:29.717009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88e607-5742-4ec2-974e-fe68d1546411 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:29.718460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:29.723716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31d39-94f9-4c66-a246-4afadc04caae None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:29.724131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31d39-94f9-4c66-a246-4afadc04caae None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:29.724247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31d39-94f9-4c66-a246-4afadc04caae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:29.742346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-76c31d39-94f9-4c66-a246-4afadc04caae None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:29.743541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-76c31d39-94f9-4c66-a246-4afadc04caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:29.814752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:29.838902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88e607-5742-4ec2-974e-fe68d1546411 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:29.947804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88e607-5742-4ec2-974e-fe68d1546411 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:29.983660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef3c6-39a5-4bea-9483-58b47aedbe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:29.984457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef3c6-39a5-4bea-9483-58b47aedbe8e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:29.984739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef3c6-39a5-4bea-9483-58b47aedbe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:29.985015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef3c6-39a5-4bea-9483-58b47aedbe8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:29.997129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ef3c6-39a5-4bea-9483-58b47aedbe8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-be8ef3c6-39a5-4bea-9483-58b47aedbe8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:30.006056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:30.007139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:30.007955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:30.013193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31d39-94f9-4c66-a246-4afadc04caae None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:30.024195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:30.119338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31d39-94f9-4c66-a246-4afadc04caae None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:30.153053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c3f23-ace9-4ea3-98fe-ee46ca489267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:30.153719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3f23-ace9-4ea3-98fe-ee46ca489267 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:30.154024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3f23-ace9-4ea3-98fe-ee46ca489267 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:30.154299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3f23-ace9-4ea3-98fe-ee46ca489267 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:30.155053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c3f23-ace9-4ea3-98fe-ee46ca489267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:30.155356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c3f23-ace9-4ea3-98fe-ee46ca489267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:30.156746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c3f23-ace9-4ea3-98fe-ee46ca489267 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:30.165110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 25/50] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:30.170907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef3c6-39a5-4bea-9483-58b47aedbe8e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:30.176161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:30.243858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dd2eb-c048-4881-a3ec-bd46d42c556a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:30.244058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dd2eb-c048-4881-a3ec-bd46d42c556a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:30.244310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dd2eb-c048-4881-a3ec-bd46d42c556a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:30.245666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 26/51] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:30.250636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc580-bc5f-49d8-8b25-8e3bc6c5da27 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:30.250922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc580-bc5f-49d8-8b25-8e3bc6c5da27 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:30.251233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bc580-bc5f-49d8-8b25-8e3bc6c5da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:30.268383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f63bc580-bc5f-49d8-8b25-8e3bc6c5da27 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:30.269587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f63bc580-bc5f-49d8-8b25-8e3bc6c5da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:30.273175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef3c6-39a5-4bea-9483-58b47aedbe8e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:30.308028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6d22a-ec05-43d8-95e1-4ff79889c298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:30.308922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d22a-ec05-43d8-95e1-4ff79889c298 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:30.309209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d22a-ec05-43d8-95e1-4ff79889c298 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:30.309483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d22a-ec05-43d8-95e1-4ff79889c298 None admin] PATH_INFO: `/v3/users/6aa38b5acec04d4fa14aadd10b58f34f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:30.310720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6d22a-ec05-43d8-95e1-4ff79889c298 None admin] RBAC: Authorizing `identity:get_user(user_id=6aa38b5acec04d4fa14aadd10b58f34f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:30.312191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6d22a-ec05-43d8-95e1-4ff79889c298 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:30.313875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 26/52] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:30 2022] GET /identity/v3/users/6aa38b5acec04d4fa14aadd10b58f34f => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:30.319271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6d22a-ec05-43d8-95e1-4ff79889c298 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:30.335961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:30.341831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 27/53] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:30.364780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bc580-bc5f-49d8-8b25-8e3bc6c5da27 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:30.391214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:30.477859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bc580-bc5f-49d8-8b25-8e3bc6c5da27 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:30.515821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbffd6-2c68-4c27-b31e-e68172bfa519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:30.516542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbffd6-2c68-4c27-b31e-e68172bfa519 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:30.516817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbffd6-2c68-4c27-b31e-e68172bfa519 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:30.517236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbffd6-2c68-4c27-b31e-e68172bfa519 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:30.518313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbffd6-2c68-4c27-b31e-e68172bfa519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:30.519791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbffd6-2c68-4c27-b31e-e68172bfa519 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:30.521766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 28/54] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:30.527355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbffd6-2c68-4c27-b31e-e68172bfa519 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:30.542747 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6d22a-ec05-43d8-95e1-4ff79889c298 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:30.576663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f1a7-2eb5-47b2-80c5-79527f731b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:30.577775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f1a7-2eb5-47b2-80c5-79527f731b46 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:30.578092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f1a7-2eb5-47b2-80c5-79527f731b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:30.578370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f1a7-2eb5-47b2-80c5-79527f731b46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:30.579566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5f1a7-2eb5-47b2-80c5-79527f731b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:30.581017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5f1a7-2eb5-47b2-80c5-79527f731b46 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:30.582685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:30.588724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f1a7-2eb5-47b2-80c5-79527f731b46 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:30.594451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:30.628825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbffd6-2c68-4c27-b31e-e68172bfa519 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:30.661888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521437a-d816-4041-a60d-f0a4c56aa9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:30.662785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521437a-d816-4041-a60d-f0a4c56aa9a9 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:30.663065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521437a-d816-4041-a60d-f0a4c56aa9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:30.663349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521437a-d816-4041-a60d-f0a4c56aa9a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:30.664105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521437a-d816-4041-a60d-f0a4c56aa9a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:30.665589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521437a-d816-4041-a60d-f0a4c56aa9a9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:30.693844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f1a7-2eb5-47b2-80c5-79527f731b46 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:30.694650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 29/56] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Jun 23 16:58:30 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:58:30.732789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69552a2-7e7b-48c8-b968-c326ca4aeb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:30.733476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69552a2-7e7b-48c8-b968-c326ca4aeb13 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:30.733755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69552a2-7e7b-48c8-b968-c326ca4aeb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:30.734063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69552a2-7e7b-48c8-b968-c326ca4aeb13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:30.734932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69552a2-7e7b-48c8-b968-c326ca4aeb13 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.domain.id=default, user.id=6aa38b5acec04d4fa14aadd10b58f34f) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:30.735224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69552a2-7e7b-48c8-b968-c326ca4aeb13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:30.736680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69552a2-7e7b-48c8-b968-c326ca4aeb13 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:30.746239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Jun 23 16:58:30 2022] GET /identity/v3/role_assignments?user.id=6aa38b5acec04d4fa14aadd10b58f34f&scope.domain.id=default&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:32.723393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786b84-e08c-4ec5-8262-9ae727ea1d85 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:32.723899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786b84-e08c-4ec5-8262-9ae727ea1d85 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:32.723899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786b84-e08c-4ec5-8262-9ae727ea1d85 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:32.725435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:32.731844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48092461-128f-41fb-a58b-8970420f6315 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:32.732521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48092461-128f-41fb-a58b-8970420f6315 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:32.732662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48092461-128f-41fb-a58b-8970420f6315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:32.742639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:32.758329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-48092461-128f-41fb-a58b-8970420f6315 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:32.759539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-48092461-128f-41fb-a58b-8970420f6315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:32.832336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:32.863573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89786b84-e08c-4ec5-8262-9ae727ea1d85 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:32.972298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89786b84-e08c-4ec5-8262-9ae727ea1d85 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:32.992859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:33.010494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9ccde-af13-4eaa-b05a-0dd1e5597e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:33.011285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ccde-af13-4eaa-b05a-0dd1e5597e8a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:33.011572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ccde-af13-4eaa-b05a-0dd1e5597e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:33.011849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ccde-af13-4eaa-b05a-0dd1e5597e8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:33.013047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9ccde-af13-4eaa-b05a-0dd1e5597e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:33.014544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9ccde-af13-4eaa-b05a-0dd1e5597e8a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:33.016179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:33.022147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48092461-128f-41fb-a58b-8970420f6315 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:33.126767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48092461-128f-41fb-a58b-8970420f6315 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:33.161828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99985-df81-4e89-b4a4-cbf3ede45344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:33.162617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99985-df81-4e89-b4a4-cbf3ede45344 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:33.162920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99985-df81-4e89-b4a4-cbf3ede45344 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:33.163195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99985-df81-4e89-b4a4-cbf3ede45344 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:33.163881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d99985-df81-4e89-b4a4-cbf3ede45344 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:33.165372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d99985-df81-4e89-b4a4-cbf3ede45344 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:33.178775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:33.203824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:58:33 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:36.292848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025b169-bad9-417b-a636-282465e9580b None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.293718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025b169-bad9-417b-a636-282465e9580b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.294164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025b169-bad9-417b-a636-282465e9580b None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.295720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:36.311457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058764d-5ec4-4803-9ba9-4c1b05b3f0e5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.312284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058764d-5ec4-4803-9ba9-4c1b05b3f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.312703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058764d-5ec4-4803-9ba9-4c1b05b3f0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.338787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7058764d-5ec4-4803-9ba9-4c1b05b3f0e5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:36.340217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7058764d-5ec4-4803-9ba9-4c1b05b3f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:36.432188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 31/63] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:36.465779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025b169-bad9-417b-a636-282465e9580b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:36.602731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025b169-bad9-417b-a636-282465e9580b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:36.650736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b78167-eb20-4daa-8134-c50a0cca3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:36.651581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b78167-eb20-4daa-8134-c50a0cca3c9e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.651857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b78167-eb20-4daa-8134-c50a0cca3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.652128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b78167-eb20-4daa-8134-c50a0cca3c9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.664058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4304ad-d22b-4f06-97f9-a87403b51518 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.664650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4304ad-d22b-4f06-97f9-a87403b51518 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.665125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4304ad-d22b-4f06-97f9-a87403b51518 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.666751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 32/64] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:36.669814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b78167-eb20-4daa-8134-c50a0cca3c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:36.675113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb9c85-ba88-4d4d-a0d0-158fb39a009f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.675404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb9c85-ba88-4d4d-a0d0-158fb39a009f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.675686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb9c85-ba88-4d4d-a0d0-158fb39a009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e6b78167-eb20-4daa-8134-c50a0cca3c9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:36.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:36.677600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 33/65] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:36.679486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d6915-3cc9-40ed-8a88-e6d89f4e5e01 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.680202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d6915-3cc9-40ed-8a88-e6d89f4e5e01 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.680202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d6915-3cc9-40ed-8a88-e6d89f4e5e01 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.681355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 34/66] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:36.686625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bdc9a-2a1f-4f5c-ae18-4f14f2784f94 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.687094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bdc9a-2a1f-4f5c-ae18-4f14f2784f94 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.687539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bdc9a-2a1f-4f5c-ae18-4f14f2784f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.705661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e1bb9c85-ba88-4d4d-a0d0-158fb39a009f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:36.707235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e1bb9c85-ba88-4d4d-a0d0-158fb39a009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:36.711070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a62bdc9a-2a1f-4f5c-ae18-4f14f2784f94 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:36.712418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a62bdc9a-2a1f-4f5c-ae18-4f14f2784f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:36.759191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:36.784738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 35/68] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:36.790135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 33/68] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:36.790971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bdc9a-2a1f-4f5c-ae18-4f14f2784f94 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:36.810548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb9c85-ba88-4d4d-a0d0-158fb39a009f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:36.872374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:36.927607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb9c85-ba88-4d4d-a0d0-158fb39a009f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:36.927798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bdc9a-2a1f-4f5c-ae18-4f14f2784f94 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:36.966410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec1aa-495f-4f9a-b851-b0ae7993b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:36.967244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec1aa-495f-4f9a-b851-b0ae7993b092 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.967492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:36.967601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec1aa-495f-4f9a-b851-b0ae7993b092 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.967889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec1aa-495f-4f9a-b851-b0ae7993b092 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.968675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.969138 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.969591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.970574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:36.971071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:36.972656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:36.979200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec1aa-495f-4f9a-b851-b0ae7993b092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:36.986049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 36/69] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:36.986049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-326ec1aa-495f-4f9a-b851-b0ae7993b092 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:36.986873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:36.987741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:36.988515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 34/70] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:58:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:58:36.989890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad0af1-abb1-4784-b50d-cc9a9d42e6d5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:36.989890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad0af1-abb1-4784-b50d-cc9a9d42e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:36.990038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad0af1-abb1-4784-b50d-cc9a9d42e6d5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:36.995545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 35/71] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:36.995545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad0af1-abb1-4784-b50d-cc9a9d42e6d5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.040635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.100761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad0af1-abb1-4784-b50d-cc9a9d42e6d5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.102544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd300-a9a9-4ff5-b9ff-466f7b809deb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.110975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.134721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b8fe1-17ba-4981-8af3-5d0f7c8ec2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.135550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8fe1-17ba-4981-8af3-5d0f7c8ec2af None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.135832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8fe1-17ba-4981-8af3-5d0f7c8ec2af None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.136103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b8fe1-17ba-4981-8af3-5d0f7c8ec2af None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.137460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc705-0349-4b55-b0cb-aff3a79391c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.138462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc705-0349-4b55-b0cb-aff3a79391c5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.139527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc705-0349-4b55-b0cb-aff3a79391c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.139818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc705-0349-4b55-b0cb-aff3a79391c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.150546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc705-0349-4b55-b0cb-aff3a79391c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:37.151206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b8fe1-17ba-4981-8af3-5d0f7c8ec2af None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:37.152700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b8fe1-17ba-4981-8af3-5d0f7c8ec2af None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:37.154638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:36 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:37.155260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b8fe1-17ba-4981-8af3-5d0f7c8ec2af None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-633dc705-0349-4b55-b0cb-aff3a79391c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:37.159167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:37.160056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:37.160842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:58:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:37.161973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760d45f-4dd7-4963-8a61-6e18cdef6a4e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.161973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760d45f-4dd7-4963-8a61-6e18cdef6a4e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.162238 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760d45f-4dd7-4963-8a61-6e18cdef6a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.179187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4760d45f-4dd7-4963-8a61-6e18cdef6a4e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:37.180402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4760d45f-4dd7-4963-8a61-6e18cdef6a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:37.248328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 38/74] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:37.249888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb116e-ab5c-436e-82b3-c8cca295d75e None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.250243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb116e-ab5c-436e-82b3-c8cca295d75e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.250525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb116e-ab5c-436e-82b3-c8cca295d75e None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.253915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 39/75] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:37.253915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb116e-ab5c-436e-82b3-c8cca295d75e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.254085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b8fe1-17ba-4981-8af3-5d0f7c8ec2af None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.289459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.290170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.290455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.290693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.290784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.291585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:37.291782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:37.293194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:37.301742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 37/76] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:37.302561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.333057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.368093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb116e-ab5c-436e-82b3-c8cca295d75e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.402993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf03f1-747d-403e-a8f3-feee924aeb1b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.403168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dedb1-e3a5-4f79-9fa7-f776bf9038d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.403605 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dedb1-e3a5-4f79-9fa7-f776bf9038d0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.403890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dedb1-e3a5-4f79-9fa7-f776bf9038d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.404171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dedb1-e3a5-4f79-9fa7-f776bf9038d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.438252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f20f2-ea58-4c0f-a445-26993eb13d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.438925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f20f2-ea58-4c0f-a445-26993eb13d1f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.439209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f20f2-ea58-4c0f-a445-26993eb13d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.439493 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f20f2-ea58-4c0f-a445-26993eb13d1f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.440259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f20f2-ea58-4c0f-a445-26993eb13d1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:37.440572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f20f2-ea58-4c0f-a445-26993eb13d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:37.442005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f20f2-ea58-4c0f-a445-26993eb13d1f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:37.450313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 38/77] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:37.451512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4344e-453f-47ca-b642-b2d7292efcd3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.451800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4344e-453f-47ca-b642-b2d7292efcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.452085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4344e-453f-47ca-b642-b2d7292efcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.468893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-80f4344e-453f-47ca-b642-b2d7292efcd3 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:37.470148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-80f4344e-453f-47ca-b642-b2d7292efcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:37.475941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dedb1-e3a5-4f79-9fa7-f776bf9038d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:37.477438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dedb1-e3a5-4f79-9fa7-f776bf9038d0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:37.506229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.536016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 39/78] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:37.536887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4344e-453f-47ca-b642-b2d7292efcd3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.561415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.579534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 40/79] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:37.582749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dedb1-e3a5-4f79-9fa7-f776bf9038d0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.637454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4344e-453f-47ca-b642-b2d7292efcd3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.672089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faebd4-45d4-4fe8-b849-e5074d6fa619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.672825 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faebd4-45d4-4fe8-b849-e5074d6fa619 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.673103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faebd4-45d4-4fe8-b849-e5074d6fa619 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.673373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faebd4-45d4-4fe8-b849-e5074d6fa619 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.682115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dedb1-e3a5-4f79-9fa7-f776bf9038d0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.683522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faebd4-45d4-4fe8-b849-e5074d6fa619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-79faebd4-45d4-4fe8-b849-e5074d6fa619 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:37.691328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:37.692186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:37.692953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:37.693602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faebd4-45d4-4fe8-b849-e5074d6fa619 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.718385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.724404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f82f-f0ff-459a-ba11-1b621d65c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.725392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f82f-f0ff-459a-ba11-1b621d65c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.726174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f82f-f0ff-459a-ba11-1b621d65c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.726465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f82f-f0ff-459a-ba11-1b621d65c3f5 None admin] PATH_INFO: `/v3/users/6aa38b5acec04d4fa14aadd10b58f34f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.727675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5f82f-f0ff-459a-ba11-1b621d65c3f5 None admin] RBAC: Authorizing `identity:get_user(user_id=6aa38b5acec04d4fa14aadd10b58f34f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:37.729155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5f82f-f0ff-459a-ba11-1b621d65c3f5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:37.730881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/users/6aa38b5acec04d4fa14aadd10b58f34f => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:37.731649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f82f-f0ff-459a-ba11-1b621d65c3f5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.775730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.793998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faebd4-45d4-4fe8-b849-e5074d6fa619 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.826294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96466-5b22-47e4-86dd-88b6bb734c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.827173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96466-5b22-47e4-86dd-88b6bb734c2e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.828012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96466-5b22-47e4-86dd-88b6bb734c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.828145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96466-5b22-47e4-86dd-88b6bb734c2e None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.829261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d96466-5b22-47e4-86dd-88b6bb734c2e None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:37.830761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d96466-5b22-47e4-86dd-88b6bb734c2e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:37.832397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:37.833153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96466-5b22-47e4-86dd-88b6bb734c2e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.840898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f82f-f0ff-459a-ba11-1b621d65c3f5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.874180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d6962-d7cf-49e5-881e-e0489074c521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.874981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6962-d7cf-49e5-881e-e0489074c521 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.875260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6962-d7cf-49e5-881e-e0489074c521 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.875534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6962-d7cf-49e5-881e-e0489074c521 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.876804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d6962-d7cf-49e5-881e-e0489074c521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:37.878291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d6962-d7cf-49e5-881e-e0489074c521 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:37.880112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:37.880667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d6962-d7cf-49e5-881e-e0489074c521 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.932406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96466-5b22-47e4-86dd-88b6bb734c2e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.943897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:37.966017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1c1a-4083-47a3-b709-3374c575e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:37.966900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1c1a-4083-47a3-b709-3374c575e342 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:37.967170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1c1a-4083-47a3-b709-3374c575e342 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:37.967439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1c1a-4083-47a3-b709-3374c575e342 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:37.968637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1c1a-4083-47a3-b709-3374c575e342 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:37.970111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1c1a-4083-47a3-b709-3374c575e342 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:37.971978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 42/84] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:37.972648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1c1a-4083-47a3-b709-3374c575e342 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:37.985445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d6962-d7cf-49e5-881e-e0489074c521 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:37.991669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:38.020030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.020702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.020989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.021254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.022094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:38.022366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:38.023929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:38.031994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 43/85] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:38.032776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:38.077974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1c1a-4083-47a3-b709-3374c575e342 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.112201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fb7dd-6254-4e58-87ee-a54b67b4630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.112855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb7dd-6254-4e58-87ee-a54b67b4630f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.113134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb7dd-6254-4e58-87ee-a54b67b4630f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.113416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb7dd-6254-4e58-87ee-a54b67b4630f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.131534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc03f-851c-4e81-ab67-a9dbe9f875b9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.158212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:38.166595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0ea0-6c8b-4882-ab1f-ce60d72487e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.167249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0ea0-6c8b-4882-ab1f-ce60d72487e7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.167534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0ea0-6c8b-4882-ab1f-ce60d72487e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.167813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0ea0-6c8b-4882-ab1f-ce60d72487e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.181867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fb7dd-6254-4e58-87ee-a54b67b4630f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:38.183445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fb7dd-6254-4e58-87ee-a54b67b4630f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:38.200611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:38.234679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba0ea0-6c8b-4882-ab1f-ce60d72487e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:38.236172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba0ea0-6c8b-4882-ab1f-ce60d72487e7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:38.283083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 43/86] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:38.286650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fb7dd-6254-4e58-87ee-a54b67b4630f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:38.337216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 44/87] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:38.338109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0ea0-6c8b-4882-ab1f-ce60d72487e7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:38.364635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:38.385588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fb7dd-6254-4e58-87ee-a54b67b4630f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.402794 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:38.420275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b327313-278f-4eaf-8f74-13bddd163a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.420946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327313-278f-4eaf-8f74-13bddd163a1c None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.421231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327313-278f-4eaf-8f74-13bddd163a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.421507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327313-278f-4eaf-8f74-13bddd163a1c None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.422266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b327313-278f-4eaf-8f74-13bddd163a1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:38.423730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b327313-278f-4eaf-8f74-13bddd163a1c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:38.434343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0ea0-6c8b-4882-ab1f-ce60d72487e7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.445759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 44/88] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:58:38 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:38.446809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b327313-278f-4eaf-8f74-13bddd163a1c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:38.475812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.476505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.476789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.477066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.478236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] RBAC: Adding query filter params (role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=a54cac18fe3448119899dcb53a77d938, user.id=f4a7349d4c204fb79a3e615178e43fa9) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:38.478558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:38.480083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:38.486336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 45/89] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:38 2022] GET /identity/v3/role_assignments?user.id=f4a7349d4c204fb79a3e615178e43fa9&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:38.487218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:38.584939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b327313-278f-4eaf-8f74-13bddd163a1c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.635565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e652c4a-9393-49a1-b5cf-36d40dcefdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.637269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e652c4a-9393-49a1-b5cf-36d40dcefdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.637567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e652c4a-9393-49a1-b5cf-36d40dcefdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.637927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e652c4a-9393-49a1-b5cf-36d40dcefdd2 None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.639706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e652c4a-9393-49a1-b5cf-36d40dcefdd2 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:38.641219 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e652c4a-9393-49a1-b5cf-36d40dcefdd2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:38.643803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 45/90] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:38 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:38.644784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e652c4a-9393-49a1-b5cf-36d40dcefdd2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:38.653537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:38.668565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b13c1-196b-425e-85bc-6d1b61b6b1e8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.707866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:38.723873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424983d-40f1-495c-b0d9-b77b78d129ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.725124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424983d-40f1-495c-b0d9-b77b78d129ad None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.725731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424983d-40f1-495c-b0d9-b77b78d129ad None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.726044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424983d-40f1-495c-b0d9-b77b78d129ad None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.728604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424983d-40f1-495c-b0d9-b77b78d129ad None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:38.730344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424983d-40f1-495c-b0d9-b77b78d129ad None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:38.732747 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:38 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:38.733509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424983d-40f1-495c-b0d9-b77b78d129ad None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:38.779104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e652c4a-9393-49a1-b5cf-36d40dcefdd2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.831036 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1c4c8-2a90-4ea7-a324-5069b30b418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.831994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c4c8-2a90-4ea7-a324-5069b30b418b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.832281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c4c8-2a90-4ea7-a324-5069b30b418b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.832611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1c4c8-2a90-4ea7-a324-5069b30b418b None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.834944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1c4c8-2a90-4ea7-a324-5069b30b418b None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:38.836178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1c4c8-2a90-4ea7-a324-5069b30b418b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:38.841936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 46/92] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:38 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:38.842881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1c4c8-2a90-4ea7-a324-5069b30b418b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:38.874896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424983d-40f1-495c-b0d9-b77b78d129ad None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.915074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c8687-b5a4-4f5d-95eb-05a849c5c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:38.915755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c8687-b5a4-4f5d-95eb-05a849c5c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:38.916044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c8687-b5a4-4f5d-95eb-05a849c5c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:38.916324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c8687-b5a4-4f5d-95eb-05a849c5c3f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:38.950233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:38.982162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1c4c8-2a90-4ea7-a324-5069b30b418b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:38.995399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:39.005864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c8687-b5a4-4f5d-95eb-05a849c5c3f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:39.008025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c8687-b5a4-4f5d-95eb-05a849c5c3f4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:39.023750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:39.024518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:39.024811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:39.025096 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:39.025996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=a54cac18fe3448119899dcb53a77d938, user.id=6aa38b5acec04d4fa14aadd10b58f34f) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:39.026380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:39.027949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:39.033715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 47/93] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:38 2022] GET /identity/v3/role_assignments?user.id=6aa38b5acec04d4fa14aadd10b58f34f&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:39.042553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:39.199271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 47/94] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:39.206223 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c8687-b5a4-4f5d-95eb-05a849c5c3f4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:39.289098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064583e-50ca-4a39-b712-0544532a58eb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:39.329722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:39.356700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:39.357385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:39.357671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:39.357981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:39.358920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] RBAC: Adding query filter params (role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=a54cac18fe3448119899dcb53a77d938, user.id=f4a7349d4c204fb79a3e615178e43fa9) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:39.359244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:39.360739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:39.372632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:39 2022] GET /identity/v3/role_assignments?user.id=f4a7349d4c204fb79a3e615178e43fa9&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=de3989d133584bab8378c170cee57ac6 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:39.405599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c8687-b5a4-4f5d-95eb-05a849c5c3f4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:39.465318 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4dba6-9526-4987-8256-3fd284aaa4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:39.466156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4dba6-9526-4987-8256-3fd284aaa4cf None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:39.466443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4dba6-9526-4987-8256-3fd284aaa4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:39.466722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4dba6-9526-4987-8256-3fd284aaa4cf None admin] PATH_INFO: `/v3/projects/6b21c416b5944fc39f6c45346b8a33da` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:39.467952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4dba6-9526-4987-8256-3fd284aaa4cf None admin] RBAC: Authorizing `identity:get_project(project_id=6b21c416b5944fc39f6c45346b8a33da)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:39.469442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4dba6-9526-4987-8256-3fd284aaa4cf None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:39.471386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:39 2022] GET /identity/v3/projects/6b21c416b5944fc39f6c45346b8a33da => generated 312 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:39.477424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:39.530164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:39.617828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748be9e-59db-4e31-86e9-9557391e8e8e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:39.670657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b6475-fa69-4840-843c-ef1f07719cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:39.672602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6475-fa69-4840-843c-ef1f07719cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:39.672745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6475-fa69-4840-843c-ef1f07719cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:39.672917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b6475-fa69-4840-843c-ef1f07719cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:39.673844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b6475-fa69-4840-843c-ef1f07719cf9 None admin] RBAC: Adding query filter params (role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=6b21c416b5944fc39f6c45346b8a33da, user.id=f4a7349d4c204fb79a3e615178e43fa9) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:39.674242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b6475-fa69-4840-843c-ef1f07719cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:39.675712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b6475-fa69-4840-843c-ef1f07719cf9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:39.689404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:39 2022] GET /identity/v3/role_assignments?user.id=f4a7349d4c204fb79a3e615178e43fa9&scope.project.id=6b21c416b5944fc39f6c45346b8a33da&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:41.357542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b466e6a-6c6a-4143-96bf-5c8ca79646e2 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.358099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b466e6a-6c6a-4143-96bf-5c8ca79646e2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.358174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b466e6a-6c6a-4143-96bf-5c8ca79646e2 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.359827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:41.365408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9c6d-4e63-47ba-a8f7-5b6723dfebc5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.365895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9c6d-4e63-47ba-a8f7-5b6723dfebc5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.366201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9c6d-4e63-47ba-a8f7-5b6723dfebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.385226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-32bf9c6d-4e63-47ba-a8f7-5b6723dfebc5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:41.386474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-32bf9c6d-4e63-47ba-a8f7-5b6723dfebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:41.484705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 50/99] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:41.509681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b466e6a-6c6a-4143-96bf-5c8ca79646e2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:41.620975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b466e6a-6c6a-4143-96bf-5c8ca79646e2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:41.660132 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:41.666698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d5105-a338-4d58-b9cf-c66ec51954c1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.667003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d5105-a338-4d58-b9cf-c66ec51954c1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.667341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d5105-a338-4d58-b9cf-c66ec51954c1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.668006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc4ef-99a3-4802-9b0e-83527d9a091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:41.668817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc4ef-99a3-4802-9b0e-83527d9a091c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.669068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 51/100] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:41.669179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc4ef-99a3-4802-9b0e-83527d9a091c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.669365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc4ef-99a3-4802-9b0e-83527d9a091c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.675199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36fe5f-1709-44c0-a546-da459f42666e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.675591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36fe5f-1709-44c0-a546-da459f42666e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.675950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36fe5f-1709-44c0-a546-da459f42666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.693778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc4ef-99a3-4802-9b0e-83527d9a091c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:41.707153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3b36fe5f-1709-44c0-a546-da459f42666e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-848bc4ef-99a3-4802-9b0e-83527d9a091c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:41.707441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:41.708470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:41.709411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 50/101] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:41.717598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ac95-d94c-4108-b257-e22f1cc895b9 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.717598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ac95-d94c-4108-b257-e22f1cc895b9 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.717598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ac95-d94c-4108-b257-e22f1cc895b9 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.717598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 51/102] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:41.718619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930ac95-d94c-4108-b257-e22f1cc895b9 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:41.719664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3b36fe5f-1709-44c0-a546-da459f42666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:41.754239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:41.819969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 52/103] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:41.821274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d405-9868-45cd-881e-08ea7ef04010 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.821568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d405-9868-45cd-881e-08ea7ef04010 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.821877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d405-9868-45cd-881e-08ea7ef04010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.839559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9222d405-9868-45cd-881e-08ea7ef04010 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:41.840751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9222d405-9868-45cd-881e-08ea7ef04010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:41.878718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930ac95-d94c-4108-b257-e22f1cc895b9 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:41.914421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:41.915090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.915378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.915642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.916393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:41.916709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:41.918147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:41.920253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 53/104] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:41.927071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 52/105] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:41.927543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720047-95db-47eb-a3a3-80cd7aae9aae None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.927738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:41.928272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720047-95db-47eb-a3a3-80cd7aae9aae None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.929534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720047-95db-47eb-a3a3-80cd7aae9aae None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.931084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 54/106] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:41.936983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5c16-f3cf-4b5e-828d-1bf290843fdd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:41.937464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5c16-f3cf-4b5e-828d-1bf290843fdd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:41.937939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5c16-f3cf-4b5e-828d-1bf290843fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:41.968277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bd4a5c16-f3cf-4b5e-828d-1bf290843fdd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:41.969752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd4a5c16-f3cf-4b5e-828d-1bf290843fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:41.995191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:42.032676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d731aa7-4234-4ea6-bc5a-4f4b85c43066 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.056578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 55/107] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:42.057966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a5c16-f3cf-4b5e-828d-1bf290843fdd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.066316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89c8dd-be55-4c1b-af0c-3a6cb26036f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.067127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89c8dd-be55-4c1b-af0c-3a6cb26036f5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.067715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89c8dd-be55-4c1b-af0c-3a6cb26036f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.067715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89c8dd-be55-4c1b-af0c-3a6cb26036f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.068873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89c8dd-be55-4c1b-af0c-3a6cb26036f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:42.070460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89c8dd-be55-4c1b-af0c-3a6cb26036f5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:42.072103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 53/108] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:42.072875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89c8dd-be55-4c1b-af0c-3a6cb26036f5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.088304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:42.170944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89c8dd-be55-4c1b-af0c-3a6cb26036f5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.172866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a5c16-f3cf-4b5e-828d-1bf290843fdd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.198183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:42.205935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cfb39-34fe-42ef-9d80-ed02fcc5df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.206766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cfb39-34fe-42ef-9d80-ed02fcc5df51 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.207024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cfb39-34fe-42ef-9d80-ed02fcc5df51 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.207302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cfb39-34fe-42ef-9d80-ed02fcc5df51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.215719 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045271d1-2315-41c7-bbb8-f7d8b24d5449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.216908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045271d1-2315-41c7-bbb8-f7d8b24d5449 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.217401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045271d1-2315-41c7-bbb8-f7d8b24d5449 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.217990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045271d1-2315-41c7-bbb8-f7d8b24d5449 None admin] PATH_INFO: `/v3/users/e5d1244735ac4da088e5cde5621f3a66` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.218549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cfb39-34fe-42ef-9d80-ed02fcc5df51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-444cfb39-34fe-42ef-9d80-ed02fcc5df51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:42.226306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:42.227336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 54/109] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:42.233964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cfb39-34fe-42ef-9d80-ed02fcc5df51 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.243772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045271d1-2315-41c7-bbb8-f7d8b24d5449 None admin] RBAC: Authorizing `identity:get_user(user_id=e5d1244735ac4da088e5cde5621f3a66)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:42.245659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045271d1-2315-41c7-bbb8-f7d8b24d5449 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:42.248277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 56/110] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/users/e5d1244735ac4da088e5cde5621f3a66 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:42.249331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045271d1-2315-41c7-bbb8-f7d8b24d5449 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.340804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cfb39-34fe-42ef-9d80-ed02fcc5df51 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.342327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:42.365114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045271d1-2315-41c7-bbb8-f7d8b24d5449 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.377644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4780ac-e96c-4fe2-8dc0-bf9839aad43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.378392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4780ac-e96c-4fe2-8dc0-bf9839aad43f None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.378976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4780ac-e96c-4fe2-8dc0-bf9839aad43f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.379090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4780ac-e96c-4fe2-8dc0-bf9839aad43f None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.379775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4780ac-e96c-4fe2-8dc0-bf9839aad43f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:42.381378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4780ac-e96c-4fe2-8dc0-bf9839aad43f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:42.408280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7062a5-15ba-4b78-817d-0e46f19d06b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.409928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7062a5-15ba-4b78-817d-0e46f19d06b0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.410368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7062a5-15ba-4b78-817d-0e46f19d06b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.410776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7062a5-15ba-4b78-817d-0e46f19d06b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.411338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 55/111] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 16:58:42 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:42.412354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4780ac-e96c-4fe2-8dc0-bf9839aad43f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.431544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7062a5-15ba-4b78-817d-0e46f19d06b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5a7062a5-15ba-4b78-817d-0e46f19d06b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:42.441855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:42.442867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:42.443638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:42.445987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 57/112] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:42.445987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7062a5-15ba-4b78-817d-0e46f19d06b0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.488946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:42.537099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4780ac-e96c-4fe2-8dc0-bf9839aad43f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.571287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7062a5-15ba-4b78-817d-0e46f19d06b0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.580213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730080ef-352f-4c14-aa9c-8a531115916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.580922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730080ef-352f-4c14-aa9c-8a531115916b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.581204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730080ef-352f-4c14-aa9c-8a531115916b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.581478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730080ef-352f-4c14-aa9c-8a531115916b None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.582305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730080ef-352f-4c14-aa9c-8a531115916b None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:42.582614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730080ef-352f-4c14-aa9c-8a531115916b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:42.584156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730080ef-352f-4c14-aa9c-8a531115916b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:42.594182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 56/113] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:42.595658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d785-72e8-4b30-bd87-7bf5f20cdae5 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.595956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d785-72e8-4b30-bd87-7bf5f20cdae5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.596241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d785-72e8-4b30-bd87-7bf5f20cdae5 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.597694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 57/114] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:42.598243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5d785-72e8-4b30-bd87-7bf5f20cdae5 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.612931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecddcc8-4788-46e2-beaf-009d847e86ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.613841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddcc8-4788-46e2-beaf-009d847e86ed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.614012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddcc8-4788-46e2-beaf-009d847e86ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.614265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecddcc8-4788-46e2-beaf-009d847e86ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.627153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:42.703879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecddcc8-4788-46e2-beaf-009d847e86ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:42.705633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecddcc8-4788-46e2-beaf-009d847e86ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:42.721272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:42.732316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5d785-72e8-4b30-bd87-7bf5f20cdae5 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.770631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.771528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.771915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.772381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.773279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:42.773657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:42.775224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:42.784727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 58/115] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:42.785646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.842653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 58/116] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:42.844313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d538e-b9ea-479f-9d12-89fe558a46ff None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.845056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d538e-b9ea-479f-9d12-89fe558a46ff None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.845341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d538e-b9ea-479f-9d12-89fe558a46ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.872304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ef1d538e-b9ea-479f-9d12-89fe558a46ff None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:42.874125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ef1d538e-b9ea-479f-9d12-89fe558a46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:42.909007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34c66c-67b1-4892-8c5f-52e5b88aa7f2 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:42.918520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:42.947344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0bb58-49c9-4b80-9802-8e373d6e3d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:42.948153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0bb58-49c9-4b80-9802-8e373d6e3d5f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:42.948501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0bb58-49c9-4b80-9802-8e373d6e3d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:42.948787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0bb58-49c9-4b80-9802-8e373d6e3d5f None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:42.950042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0bb58-49c9-4b80-9802-8e373d6e3d5f None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:42.951502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0bb58-49c9-4b80-9802-8e373d6e3d5f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:42.953522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 59/117] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:42.953909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 59/118] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:42.954324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0bb58-49c9-4b80-9802-8e373d6e3d5f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.955093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d538e-b9ea-479f-9d12-89fe558a46ff None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:42.989574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:43.066131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d538e-b9ea-479f-9d12-89fe558a46ff None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.066688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0bb58-49c9-4b80-9802-8e373d6e3d5f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.103692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873acba-feff-4211-a489-32992ee0b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.104090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c986d7b-77b1-4088-8303-7c4062ac60fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.104566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873acba-feff-4211-a489-32992ee0b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.104845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873acba-feff-4211-a489-32992ee0b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.105009 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986d7b-77b1-4088-8303-7c4062ac60fd None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.105113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873acba-feff-4211-a489-32992ee0b7b7 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.105265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986d7b-77b1-4088-8303-7c4062ac60fd None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.105546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c986d7b-77b1-4088-8303-7c4062ac60fd None admin] PATH_INFO: `/v3/users/6aa38b5acec04d4fa14aadd10b58f34f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.106424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873acba-feff-4211-a489-32992ee0b7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:43.106793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c986d7b-77b1-4088-8303-7c4062ac60fd None admin] RBAC: Authorizing `identity:get_user(user_id=6aa38b5acec04d4fa14aadd10b58f34f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:43.107885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873acba-feff-4211-a489-32992ee0b7b7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:43.108260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c986d7b-77b1-4088-8303-7c4062ac60fd None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:43.114641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 60/119] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:43.114782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 60/120] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:42 2022] GET /identity/v3/users/6aa38b5acec04d4fa14aadd10b58f34f => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:43.114782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c986d7b-77b1-4088-8303-7c4062ac60fd None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.114943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c027e-139a-4a42-9158-9d2797d19e4a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.114943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c027e-139a-4a42-9158-9d2797d19e4a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.114943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c027e-139a-4a42-9158-9d2797d19e4a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.114943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 61/121] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:43.114943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c027e-139a-4a42-9158-9d2797d19e4a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.161262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:43.224886 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:43.230519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c027e-139a-4a42-9158-9d2797d19e4a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.236317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c986d7b-77b1-4088-8303-7c4062ac60fd None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.264674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ecd13-77f7-4e8f-b0e5-159a0811aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.265520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ecd13-77f7-4e8f-b0e5-159a0811aa26 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.265829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ecd13-77f7-4e8f-b0e5-159a0811aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.266119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ecd13-77f7-4e8f-b0e5-159a0811aa26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.274320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cca11c-018b-4cc3-aca2-2f0f9bf89a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.275197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cca11c-018b-4cc3-aca2-2f0f9bf89a6a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.275483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cca11c-018b-4cc3-aca2-2f0f9bf89a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.275764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cca11c-018b-4cc3-aca2-2f0f9bf89a6a None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.276462 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ecd13-77f7-4e8f-b0e5-159a0811aa26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:43.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cca11c-018b-4cc3-aca2-2f0f9bf89a6a None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:43.278548 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cca11c-018b-4cc3-aca2-2f0f9bf89a6a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:43.285155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 61/122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:43 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:43.285155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cca11c-018b-4cc3-aca2-2f0f9bf89a6a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-aa5ecd13-77f7-4e8f-b0e5-159a0811aa26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:43.285329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:43.286453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 62/123] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:58:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:43.287228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ecd13-77f7-4e8f-b0e5-159a0811aa26 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.387629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:43.391466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ecd13-77f7-4e8f-b0e5-159a0811aa26 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.396364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cca11c-018b-4cc3-aca2-2f0f9bf89a6a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.429890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.430604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.430925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.431292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.432524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] RBAC: Adding query filter params (role.id=2affecf7dda148d6a834671d7fa0ef8d, scope.project.id=a54cac18fe3448119899dcb53a77d938, user.id=e5d1244735ac4da088e5cde5621f3a66) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:43.432685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fdae6-c86e-410e-a180-5c08f894c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.432857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:43.433532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fdae6-c86e-410e-a180-5c08f894c656 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.433850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fdae6-c86e-410e-a180-5c08f894c656 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.434133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fdae6-c86e-410e-a180-5c08f894c656 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.434403 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:43.435309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fdae6-c86e-410e-a180-5c08f894c656 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:43.436755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fdae6-c86e-410e-a180-5c08f894c656 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:43.438496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:43 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:43.443285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5910-f425-4594-90e2-8b9b2505eb9f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.443285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5910-f425-4594-90e2-8b9b2505eb9f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.443285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5910-f425-4594-90e2-8b9b2505eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.445680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 63/125] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:43 2022] GET /identity/v3/role_assignments?user.id=e5d1244735ac4da088e5cde5621f3a66&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=2affecf7dda148d6a834671d7fa0ef8d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:43.454945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.468016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-fb8e5910-f425-4594-90e2-8b9b2505eb9f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:43.469709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fb8e5910-f425-4594-90e2-8b9b2505eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:43.498771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:43.572282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 63/126] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:43.572498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c08a-bbb2-4afc-a021-6656df2a31a4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.573618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5910-f425-4594-90e2-8b9b2505eb9f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.619738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d105830-0a78-4bbf-9232-57ec50d9b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.620925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d105830-0a78-4bbf-9232-57ec50d9b0bf None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.621204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d105830-0a78-4bbf-9232-57ec50d9b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.621477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d105830-0a78-4bbf-9232-57ec50d9b0bf None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938/users/f4a7349d4c204fb79a3e615178e43fa9/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.624060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d105830-0a78-4bbf-9232-57ec50d9b0bf None admin] RBAC: Authorizing `identity:create_grant(project_id=a54cac18fe3448119899dcb53a77d938, user_id=f4a7349d4c204fb79a3e615178e43fa9, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:43.625634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d105830-0a78-4bbf-9232-57ec50d9b0bf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:43.643842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 64/127] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:58:43 2022] PUT /identity/v3/projects/a54cac18fe3448119899dcb53a77d938/users/f4a7349d4c204fb79a3e615178e43fa9/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:58:43.644994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d105830-0a78-4bbf-9232-57ec50d9b0bf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.716519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:43.789199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5910-f425-4594-90e2-8b9b2505eb9f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.816320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d105830-0a78-4bbf-9232-57ec50d9b0bf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:43.869778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.870629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.870967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.871324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.872175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:43.872551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:43.872986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a4501-51df-40de-8c12-de47dc7d87b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:43.874136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:43.874771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4501-51df-40de-8c12-de47dc7d87b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:43.875217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4501-51df-40de-8c12-de47dc7d87b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:43.875646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4501-51df-40de-8c12-de47dc7d87b7 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938/users/6aa38b5acec04d4fa14aadd10b58f34f/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:43.878911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a4501-51df-40de-8c12-de47dc7d87b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a54cac18fe3448119899dcb53a77d938, user_id=6aa38b5acec04d4fa14aadd10b58f34f, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:43.882590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a4501-51df-40de-8c12-de47dc7d87b7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:43.884416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 64/128] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:58:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:43.885340 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.906034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 65/129] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:58:43 2022] PUT /identity/v3/projects/a54cac18fe3448119899dcb53a77d938/users/6aa38b5acec04d4fa14aadd10b58f34f/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:58:43.907998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a4501-51df-40de-8c12-de47dc7d87b7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:43.921288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:44.011117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:44.034715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a4501-51df-40de-8c12-de47dc7d87b7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:44.066878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4220f5-f7e9-43e5-966a-d3e3d3909151 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:44.073442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbe484-c716-4d63-afbc-b9ccf1edba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:44.074629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbe484-c716-4d63-afbc-b9ccf1edba46 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:44.075119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbe484-c716-4d63-afbc-b9ccf1edba46 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:44.075564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbe484-c716-4d63-afbc-b9ccf1edba46 None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:44.077020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbe484-c716-4d63-afbc-b9ccf1edba46 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:44.079052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbe484-c716-4d63-afbc-b9ccf1edba46 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:44.081012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 66/130] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:43 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:44.087589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbe484-c716-4d63-afbc-b9ccf1edba46 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:44.112121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44e560-3ee3-440b-ab43-566d5124519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:44.112950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44e560-3ee3-440b-ab43-566d5124519e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:44.113291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44e560-3ee3-440b-ab43-566d5124519e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:44.113573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44e560-3ee3-440b-ab43-566d5124519e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:44.124980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44e560-3ee3-440b-ab43-566d5124519e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-bc44e560-3ee3-440b-ab43-566d5124519e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:44.133044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:44.134248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:44.135296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 65/131] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:44.140408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44e560-3ee3-440b-ab43-566d5124519e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:44.223343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbe484-c716-4d63-afbc-b9ccf1edba46 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:44.227541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:44.251074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44e560-3ee3-440b-ab43-566d5124519e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:44.267651 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570b16-183c-4ff6-ab3c-ec34df7e8d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:44.268891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570b16-183c-4ff6-ab3c-ec34df7e8d67 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:44.269357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570b16-183c-4ff6-ab3c-ec34df7e8d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:44.269776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570b16-183c-4ff6-ab3c-ec34df7e8d67 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:44.271191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3570b16-183c-4ff6-ab3c-ec34df7e8d67 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:44.272843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3570b16-183c-4ff6-ab3c-ec34df7e8d67 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:44.274870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 67/132] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:44 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:44.281863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570b16-183c-4ff6-ab3c-ec34df7e8d67 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:44.291391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:44.292081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:44.292366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:44.292644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:44.293406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:44.294204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:44.295162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:44.305332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 66/133] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:44.308059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:44.310770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:44.435431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7accb-f393-419a-be25-948ffb368f2c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:44.446396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570b16-183c-4ff6-ab3c-ec34df7e8d67 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:44.477077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849ef75-bb5a-4dd2-b07b-97ecbd0c8d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:44.478492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ef75-bb5a-4dd2-b07b-97ecbd0c8d8a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:44.479172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ef75-bb5a-4dd2-b07b-97ecbd0c8d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:44.479593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ef75-bb5a-4dd2-b07b-97ecbd0c8d8a None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:44.480979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849ef75-bb5a-4dd2-b07b-97ecbd0c8d8a None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:44.482949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849ef75-bb5a-4dd2-b07b-97ecbd0c8d8a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:44.484750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 67/134] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:44 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:44.490649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849ef75-bb5a-4dd2-b07b-97ecbd0c8d8a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:44.509696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:44.547959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914132d8-d1ba-439f-828f-be9538618d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:44.548953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914132d8-d1ba-439f-828f-be9538618d06 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:44.549245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914132d8-d1ba-439f-828f-be9538618d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:44.549741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914132d8-d1ba-439f-828f-be9538618d06 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938/users/f4a7349d4c204fb79a3e615178e43fa9/roles/de3989d133584bab8378c170cee57ac6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:44.551815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914132d8-d1ba-439f-828f-be9538618d06 None admin] RBAC: Authorizing `identity:create_grant(project_id=a54cac18fe3448119899dcb53a77d938, user_id=f4a7349d4c204fb79a3e615178e43fa9, role_id=de3989d133584bab8378c170cee57ac6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:44.553504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914132d8-d1ba-439f-828f-be9538618d06 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:44.586151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 68/135] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:58:44 2022] PUT /identity/v3/projects/a54cac18fe3448119899dcb53a77d938/users/f4a7349d4c204fb79a3e615178e43fa9/roles/de3989d133584bab8378c170cee57ac6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:58:44.646896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849ef75-bb5a-4dd2-b07b-97ecbd0c8d8a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:44.695199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d9c78-f4f5-4fa8-8cde-370d58286e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:44.696361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d9c78-f4f5-4fa8-8cde-370d58286e07 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:44.696779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d9c78-f4f5-4fa8-8cde-370d58286e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:44.697187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d9c78-f4f5-4fa8-8cde-370d58286e07 None admin] PATH_INFO: `/v3/projects/6b21c416b5944fc39f6c45346b8a33da` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:44.698550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d9c78-f4f5-4fa8-8cde-370d58286e07 None admin] RBAC: Authorizing `identity:get_project(project_id=6b21c416b5944fc39f6c45346b8a33da)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:44.700169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d9c78-f4f5-4fa8-8cde-370d58286e07 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:44.702143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 68/136] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:44 2022] GET /identity/v3/projects/6b21c416b5944fc39f6c45346b8a33da => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:44.708550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914132d8-d1ba-439f-828f-be9538618d06 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:44.806783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:44.830321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914132d8-d1ba-439f-828f-be9538618d06 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:44.866997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f741a-bc2b-408c-ab9e-b32cda49457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:44.867928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f741a-bc2b-408c-ab9e-b32cda49457e None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:44.868216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f741a-bc2b-408c-ab9e-b32cda49457e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:44.868494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f741a-bc2b-408c-ab9e-b32cda49457e None admin] PATH_INFO: `/v3/projects/6b21c416b5944fc39f6c45346b8a33da/users/f4a7349d4c204fb79a3e615178e43fa9/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:44.870666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f741a-bc2b-408c-ab9e-b32cda49457e None admin] RBAC: Authorizing `identity:create_grant(project_id=6b21c416b5944fc39f6c45346b8a33da, user_id=f4a7349d4c204fb79a3e615178e43fa9, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:44.872178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f741a-bc2b-408c-ab9e-b32cda49457e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:44.894679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:58:44 2022] PUT /identity/v3/projects/6b21c416b5944fc39f6c45346b8a33da/users/f4a7349d4c204fb79a3e615178e43fa9/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:58:45.050214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c422-babf-45b7-94d8-bd5a9f325a61 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:45.050868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c422-babf-45b7-94d8-bd5a9f325a61 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:45.051435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c422-babf-45b7-94d8-bd5a9f325a61 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:45.053310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 69/138] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:45.060470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444d73-c84a-4313-b969-3cf2126c8060 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:45.061122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444d73-c84a-4313-b969-3cf2126c8060 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:45.061595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444d73-c84a-4313-b969-3cf2126c8060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:45.080110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-72444d73-c84a-4313-b969-3cf2126c8060 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:45.081663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-72444d73-c84a-4313-b969-3cf2126c8060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:45.166645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 70/139] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:45.209188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649c422-babf-45b7-94d8-bd5a9f325a61 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:45.329993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:45.358696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649c422-babf-45b7-94d8-bd5a9f325a61 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:45.394030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e4dd4-54db-4299-9e2b-168c5acf5f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:45.395228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4dd4-54db-4299-9e2b-168c5acf5f0d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:45.395727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4dd4-54db-4299-9e2b-168c5acf5f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:45.396210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e4dd4-54db-4299-9e2b-168c5acf5f0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:45.397649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e4dd4-54db-4299-9e2b-168c5acf5f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:45.399327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e4dd4-54db-4299-9e2b-168c5acf5f0d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:45.401191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 70/140] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:45.407108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72444d73-c84a-4313-b969-3cf2126c8060 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:45.486911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:45.540601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72444d73-c84a-4313-b969-3cf2126c8060 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:45.587387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109798c7-03bb-48f9-863d-004ff6b110aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:45.588419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109798c7-03bb-48f9-863d-004ff6b110aa None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:45.588829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109798c7-03bb-48f9-863d-004ff6b110aa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:45.589248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109798c7-03bb-48f9-863d-004ff6b110aa None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:45.590485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109798c7-03bb-48f9-863d-004ff6b110aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:45.592780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109798c7-03bb-48f9-863d-004ff6b110aa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:45.624503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 71/141] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:58:45 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:46.375646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cff87-107d-4918-ab5d-8b472f713792 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:46.376167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cff87-107d-4918-ab5d-8b472f713792 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:46.376167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cff87-107d-4918-ab5d-8b472f713792 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:46.377574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 71/142] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:46.383190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743930-97e5-4c0b-9a2f-7ccea3189c99 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:46.383482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743930-97e5-4c0b-9a2f-7ccea3189c99 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:46.383760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743930-97e5-4c0b-9a2f-7ccea3189c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:46.407889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9f743930-97e5-4c0b-9a2f-7ccea3189c99 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:46.409080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9f743930-97e5-4c0b-9a2f-7ccea3189c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:46.493278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 72/143] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:46.527499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cff87-107d-4918-ab5d-8b472f713792 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:46.636932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0300b-81e5-4ef3-a8ac-bcb367c45da1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:46.637219 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0300b-81e5-4ef3-a8ac-bcb367c45da1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:46.637404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0300b-81e5-4ef3-a8ac-bcb367c45da1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:46.639029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 73/144] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:46.644247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae847c4-d9bd-409c-94e7-721498199ae0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:46.644762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae847c4-d9bd-409c-94e7-721498199ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:46.645231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae847c4-d9bd-409c-94e7-721498199ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:46.652945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cff87-107d-4918-ab5d-8b472f713792 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:46.671821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4ae847c4-d9bd-409c-94e7-721498199ae0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:46.673381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4ae847c4-d9bd-409c-94e7-721498199ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:46.690564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a07cd-bd94-4a08-9775-4133f0b51bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:46.691388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a07cd-bd94-4a08-9775-4133f0b51bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:46.691679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a07cd-bd94-4a08-9775-4133f0b51bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:46.691949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a07cd-bd94-4a08-9775-4133f0b51bc0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:46.704559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a07cd-bd94-4a08-9775-4133f0b51bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-474a07cd-bd94-4a08-9775-4133f0b51bc0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:46.713368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:46.714296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:46.715056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 72/145] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:46.721471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a07cd-bd94-4a08-9775-4133f0b51bc0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:46.732206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:46.751769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:46.786067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 74/146] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:46.806948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae847c4-d9bd-409c-94e7-721498199ae0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:46.932264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a07cd-bd94-4a08-9775-4133f0b51bc0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:46.952857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae847c4-d9bd-409c-94e7-721498199ae0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:46.997918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf71-e163-4999-96de-cb4647d882fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:46.999292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf71-e163-4999-96de-cb4647d882fa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:46.999786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf71-e163-4999-96de-cb4647d882fa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.000245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf71-e163-4999-96de-cb4647d882fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.002712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a8991-20f8-440b-9744-2e0bf2e3f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:47.002921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8991-20f8-440b-9744-2e0bf2e3f29e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.003154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8991-20f8-440b-9744-2e0bf2e3f29e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.003433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a8991-20f8-440b-9744-2e0bf2e3f29e None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.004282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8991-20f8-440b-9744-2e0bf2e3f29e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:47.004594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8991-20f8-440b-9744-2e0bf2e3f29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:47.006380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a8991-20f8-440b-9744-2e0bf2e3f29e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:47.018923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 73/147] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:47.025847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b83ba-7b9a-4408-bcbc-42704c9fd6a9 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.026140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b83ba-7b9a-4408-bcbc-42704c9fd6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.026424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b83ba-7b9a-4408-bcbc-42704c9fd6a9 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.031054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 74/148] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:47.032572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dcf71-e163-4999-96de-cb4647d882fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:47.033703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86fdfb-173b-40cb-b751-d4c87883d62a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.034028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86fdfb-173b-40cb-b751-d4c87883d62a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.034302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86fdfb-173b-40cb-b751-d4c87883d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9b0dcf71-e163-4999-96de-cb4647d882fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:47.041683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:47.042570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:47.043349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:47.045703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 75/149] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:47.051532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf71-e163-4999-96de-cb4647d882fa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:47.054628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-5c86fdfb-173b-40cb-b751-d4c87883d62a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:47.054628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5c86fdfb-173b-40cb-b751-d4c87883d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:47.110386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:47.131840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:47.141842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 75/150] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:47.150986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86fdfb-173b-40cb-b751-d4c87883d62a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:47.197561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf71-e163-4999-96de-cb4647d882fa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:47.243709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c367d-593f-44a0-8515-87f3ea11ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:47.244304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c367d-593f-44a0-8515-87f3ea11ff24 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.244694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c367d-593f-44a0-8515-87f3ea11ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.244973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c367d-593f-44a0-8515-87f3ea11ff24 None admin] PATH_INFO: `/v3/users/e5d1244735ac4da088e5cde5621f3a66` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.246489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c367d-593f-44a0-8515-87f3ea11ff24 None admin] RBAC: Authorizing `identity:get_user(user_id=e5d1244735ac4da088e5cde5621f3a66)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:47.248977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c367d-593f-44a0-8515-87f3ea11ff24 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:47.250674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 76/151] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:47 2022] GET /identity/v3/users/e5d1244735ac4da088e5cde5621f3a66 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:47.254586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c367d-593f-44a0-8515-87f3ea11ff24 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:47.304836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86fdfb-173b-40cb-b751-d4c87883d62a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:47.344807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:47.345961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.346492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.346960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.347999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:47.348499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:47.350296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:47.360711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 76/152] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:47.361881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:47.384077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c367d-593f-44a0-8515-87f3ea11ff24 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:47.401837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:47.433466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f42f72-d532-45bb-8cd9-ce2b03d2b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:47.434672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f42f72-d532-45bb-8cd9-ce2b03d2b200 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.435154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f42f72-d532-45bb-8cd9-ce2b03d2b200 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.435633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f42f72-d532-45bb-8cd9-ce2b03d2b200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.437952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:47.448946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f42f72-d532-45bb-8cd9-ce2b03d2b200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d5f42f72-d532-45bb-8cd9-ce2b03d2b200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:47.457880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:47.458764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:47.459809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:47.462616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 77/153] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:47.463695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f42f72-d532-45bb-8cd9-ce2b03d2b200 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:47.505438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38a9b-d97e-48e0-937b-6e5c5eea7c42 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:47.559157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce61b-6975-436a-9d63-e98023f85025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:47.560051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce61b-6975-436a-9d63-e98023f85025 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.560332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce61b-6975-436a-9d63-e98023f85025 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.560603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce61b-6975-436a-9d63-e98023f85025 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.561843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ce61b-6975-436a-9d63-e98023f85025 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:47.563332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ce61b-6975-436a-9d63-e98023f85025 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:47.565386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 77/154] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:47 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:47.566200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce61b-6975-436a-9d63-e98023f85025 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:47.584476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f42f72-d532-45bb-8cd9-ce2b03d2b200 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:47.642311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb3e8e-6d08-4c8d-aecc-a54220c4ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:47.643643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb3e8e-6d08-4c8d-aecc-a54220c4ec26 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.644244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb3e8e-6d08-4c8d-aecc-a54220c4ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.644753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb3e8e-6d08-4c8d-aecc-a54220c4ec26 None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.647941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb3e8e-6d08-4c8d-aecc-a54220c4ec26 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:47.649739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb3e8e-6d08-4c8d-aecc-a54220c4ec26 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:47.651710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 78/155] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:47 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:47.652720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb3e8e-6d08-4c8d-aecc-a54220c4ec26 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:47.723315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:47.787046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb3e8e-6d08-4c8d-aecc-a54220c4ec26 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:47.794622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce61b-6975-436a-9d63-e98023f85025 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:47.824665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a0ca-7996-4f4d-8f51-0379998c0adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:47.826017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a0ca-7996-4f4d-8f51-0379998c0adc None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.826530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a0ca-7996-4f4d-8f51-0379998c0adc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.827011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a0ca-7996-4f4d-8f51-0379998c0adc None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938/users/e5d1244735ac4da088e5cde5621f3a66/roles/2affecf7dda148d6a834671d7fa0ef8d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.829639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a0ca-7996-4f4d-8f51-0379998c0adc None admin] RBAC: Authorizing `identity:create_grant(project_id=a54cac18fe3448119899dcb53a77d938, user_id=e5d1244735ac4da088e5cde5621f3a66, role_id=2affecf7dda148d6a834671d7fa0ef8d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:47.831444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a0ca-7996-4f4d-8f51-0379998c0adc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:47.832091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:47.851771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 79/156] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:58:47 2022] PUT /identity/v3/projects/a54cac18fe3448119899dcb53a77d938/users/e5d1244735ac4da088e5cde5621f3a66/roles/2affecf7dda148d6a834671d7fa0ef8d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:58:47.853959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a0ca-7996-4f4d-8f51-0379998c0adc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:47.856415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:47.858099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:47.860004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:47.860531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:47.862581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:47.863142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:47.870137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:47.885378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 78/157] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:47.892635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:48.072514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:48.078543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a0ca-7996-4f4d-8f51-0379998c0adc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:48.130640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d424d-7a3b-40c2-99b1-f4b6d56d90a6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:48.154497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebbf27-d741-4816-be6a-eb8b843e85ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:48.155163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbf27-d741-4816-be6a-eb8b843e85ab None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:48.155441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbf27-d741-4816-be6a-eb8b843e85ab None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:48.155712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebbf27-d741-4816-be6a-eb8b843e85ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:48.204543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e301-7937-4f55-b3ee-244e4eb89e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:48.205455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e301-7937-4f55-b3ee-244e4eb89e69 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:48.205725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e301-7937-4f55-b3ee-244e4eb89e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:48.206031 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e301-7937-4f55-b3ee-244e4eb89e69 None admin] PATH_INFO: `/v3/users/6aa38b5acec04d4fa14aadd10b58f34f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:48.208259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514e301-7937-4f55-b3ee-244e4eb89e69 None admin] RBAC: Authorizing `identity:get_user(user_id=6aa38b5acec04d4fa14aadd10b58f34f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:48.209884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514e301-7937-4f55-b3ee-244e4eb89e69 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:48.217899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 79/158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:47 2022] GET /identity/v3/users/6aa38b5acec04d4fa14aadd10b58f34f => generated 247 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:48.224683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e301-7937-4f55-b3ee-244e4eb89e69 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:48.298451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebbf27-d741-4816-be6a-eb8b843e85ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:48.299951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebbf27-d741-4816-be6a-eb8b843e85ab None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:48.336799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:48.431690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e301-7937-4f55-b3ee-244e4eb89e69 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:48.498040 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02e870-48f2-4540-81f8-963a0660e255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:48.498867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02e870-48f2-4540-81f8-963a0660e255 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:48.499156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02e870-48f2-4540-81f8-963a0660e255 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:48.499428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02e870-48f2-4540-81f8-963a0660e255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:48.550888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:48.555144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 80/159] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:48.556539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320418-5d68-43ef-99b3-f85ec72762d8 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:48.556808 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320418-5d68-43ef-99b3-f85ec72762d8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:48.562110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320418-5d68-43ef-99b3-f85ec72762d8 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:48.563839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 81/160] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:48.564592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58320418-5d68-43ef-99b3-f85ec72762d8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:48.652363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02e870-48f2-4540-81f8-963a0660e255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:48.653823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02e870-48f2-4540-81f8-963a0660e255 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:48.781415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:48.799953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58320418-5d68-43ef-99b3-f85ec72762d8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:48.863999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 80/161] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 16:58:48.865777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b53ee-6580-4d13-a134-50b2bfa9ece2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:48.870508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b53ee-6580-4d13-a134-50b2bfa9ece2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:48.871005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b53ee-6580-4d13-a134-50b2bfa9ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:48.875066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bbb8e-3e34-4999-bf88-4ecb4bef477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:48.875960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bbb8e-3e34-4999-bf88-4ecb4bef477d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:48.876234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bbb8e-3e34-4999-bf88-4ecb4bef477d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:48.876500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bbb8e-3e34-4999-bf88-4ecb4bef477d None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:48.882622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bbb8e-3e34-4999-bf88-4ecb4bef477d None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:48.884109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bbb8e-3e34-4999-bf88-4ecb4bef477d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:48.885874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 82/162] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:48 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:48.887230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c238a-26c1-470e-85f8-1748410e4db7 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:48.887514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c238a-26c1-470e-85f8-1748410e4db7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:48.887787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c238a-26c1-470e-85f8-1748410e4db7 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:48.893615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 83/163] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:48.895540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be09e2-36d4-458d-a4bd-af8a897e26d8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:48.895829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be09e2-36d4-458d-a4bd-af8a897e26d8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:48.896101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be09e2-36d4-458d-a4bd-af8a897e26d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:48.899006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-249b53ee-6580-4d13-a134-50b2bfa9ece2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:48.900491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-249b53ee-6580-4d13-a134-50b2bfa9ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:48.925575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d0be09e2-36d4-458d-a4bd-af8a897e26d8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:48.926750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d0be09e2-36d4-458d-a4bd-af8a897e26d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:48.999252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 81/164] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:49.001197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b53ee-6580-4d13-a134-50b2bfa9ece2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:49.061000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:49.079761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 84/165] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:49.080946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be09e2-36d4-458d-a4bd-af8a897e26d8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:49.194657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:49.213481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b53ee-6580-4d13-a134-50b2bfa9ece2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:49.255099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffa319-301f-477a-aab3-05499da5007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:49.255974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffa319-301f-477a-aab3-05499da5007c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:49.256301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffa319-301f-477a-aab3-05499da5007c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:49.256982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffa319-301f-477a-aab3-05499da5007c None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:49.260202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffa319-301f-477a-aab3-05499da5007c None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:49.261704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffa319-301f-477a-aab3-05499da5007c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:49.269089 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 82/166] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:49 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:49.269945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffa319-301f-477a-aab3-05499da5007c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:49.294090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be09e2-36d4-458d-a4bd-af8a897e26d8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:49.391871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:49.392553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:49.392832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:49.393105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:49.393990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] RBAC: Adding query filter params (role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=a54cac18fe3448119899dcb53a77d938, user.id=f4a7349d4c204fb79a3e615178e43fa9) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:49.394302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:49.395765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:49.409288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 85/167] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:49 2022] GET /identity/v3/role_assignments?user.id=f4a7349d4c204fb79a3e615178e43fa9&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:49.410154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:49.444887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffa319-301f-477a-aab3-05499da5007c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:49.495682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb157dd-be72-4f79-a2f7-e9a7a7e3950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:49.496542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb157dd-be72-4f79-a2f7-e9a7a7e3950d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:49.496819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb157dd-be72-4f79-a2f7-e9a7a7e3950d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:49.497091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb157dd-be72-4f79-a2f7-e9a7a7e3950d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:49.538577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb157dd-be72-4f79-a2f7-e9a7a7e3950d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-2eb157dd-be72-4f79-a2f7-e9a7a7e3950d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:49.553203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:49.554822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:49.555873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:49.566757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 83/168] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:58:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:49.567533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb157dd-be72-4f79-a2f7-e9a7a7e3950d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:49.590151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:49.607208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:49.670674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80ed44-e63b-452b-92eb-c2f1cf40dbab None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:49.761535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb157dd-be72-4f79-a2f7-e9a7a7e3950d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:49.774548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfe5b7-6819-4421-ba74-deb4be80b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:49.775387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe5b7-6819-4421-ba74-deb4be80b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:49.775667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe5b7-6819-4421-ba74-deb4be80b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:49.775941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfe5b7-6819-4421-ba74-deb4be80b3e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:49.802167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfe5b7-6819-4421-ba74-deb4be80b3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:49.811100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:49.811776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:49.812056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:49.812330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:49.813177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=a54cac18fe3448119899dcb53a77d938, user.id=6aa38b5acec04d4fa14aadd10b58f34f) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:49.813490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:49.814983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:49.822025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 84/169] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:49 2022] GET /identity/v3/role_assignments?user.id=6aa38b5acec04d4fa14aadd10b58f34f&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:49.822639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-04dfe5b7-6819-4421-ba74-deb4be80b3e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:49.823273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:49.824259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:49.826504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 86/170] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:49.832531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfe5b7-6819-4421-ba74-deb4be80b3e4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:50.000583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:50.029117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0c3f2-af7b-4907-b6f8-c78e9833f691 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:50.041390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfe5b7-6819-4421-ba74-deb4be80b3e4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:50.077062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:50.079681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:50.080384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.080666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.080948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.081853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:50.082166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:50.083579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:50.090850 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:50.092014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.092314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.092600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.093686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:50.094034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:50.095237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 85/171] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:58:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:50.095481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:50.101087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:50.106510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 87/172] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:50.116295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:50.213904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70c7ee-5ccc-432e-8e77-e464adc7bea9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:50.250189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762af2-33d7-4e57-96b1-d0abcc3ae506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:50.251342 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762af2-33d7-4e57-96b1-d0abcc3ae506 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.251631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762af2-33d7-4e57-96b1-d0abcc3ae506 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.251972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762af2-33d7-4e57-96b1-d0abcc3ae506 None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.253243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0762af2-33d7-4e57-96b1-d0abcc3ae506 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:50.254890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0762af2-33d7-4e57-96b1-d0abcc3ae506 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:50.256910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 86/173] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:50 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:50.262377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762af2-33d7-4e57-96b1-d0abcc3ae506 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:50.275547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a536350-d605-494e-98e7-85069ed7a223 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:50.279677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:50.336254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50c29d-0647-4a35-92cd-a66fcca00b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:50.337362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c29d-0647-4a35-92cd-a66fcca00b6b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.337746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c29d-0647-4a35-92cd-a66fcca00b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.338155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c29d-0647-4a35-92cd-a66fcca00b6b None admin] PATH_INFO: `/v3/users/f4a7349d4c204fb79a3e615178e43fa9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.342524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50c29d-0647-4a35-92cd-a66fcca00b6b None admin] RBAC: Authorizing `identity:get_user(user_id=f4a7349d4c204fb79a3e615178e43fa9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:50.344143 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50c29d-0647-4a35-92cd-a66fcca00b6b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:50.345955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 88/174] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:50 2022] GET /identity/v3/users/f4a7349d4c204fb79a3e615178e43fa9 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:50.347267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb6e3-8a2e-4b07-b373-240059a2c3ab None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.347649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb6e3-8a2e-4b07-b373-240059a2c3ab None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.348022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeb6e3-8a2e-4b07-b373-240059a2c3ab None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.349474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 89/175] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:50.355244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b348-7cf8-44cb-8db2-7066963eff7b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.355632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b348-7cf8-44cb-8db2-7066963eff7b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.356007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b348-7cf8-44cb-8db2-7066963eff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.382468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762af2-33d7-4e57-96b1-d0abcc3ae506 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:50.383806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a710b348-7cf8-44cb-8db2-7066963eff7b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:50.385120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a710b348-7cf8-44cb-8db2-7066963eff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:50.422279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a21ed0-b611-4819-b68c-4ff3809ef722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:50.423061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a21ed0-b611-4819-b68c-4ff3809ef722 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.423344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a21ed0-b611-4819-b68c-4ff3809ef722 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.423725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a21ed0-b611-4819-b68c-4ff3809ef722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.462089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:50.496216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 90/176] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:50.497499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b348-7cf8-44cb-8db2-7066963eff7b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:50.499683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a21ed0-b611-4819-b68c-4ff3809ef722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:50.501467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a21ed0-b611-4819-b68c-4ff3809ef722 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:50.514181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:50.613112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 87/177] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 16:58:50.618083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a21ed0-b611-4819-b68c-4ff3809ef722 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:50.724695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b348-7cf8-44cb-8db2-7066963eff7b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:50.788899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b587886-bcca-46b2-ba5f-998365147046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:50.789563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b587886-bcca-46b2-ba5f-998365147046 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.790054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b587886-bcca-46b2-ba5f-998365147046 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.790307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b587886-bcca-46b2-ba5f-998365147046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.801825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a21ed0-b611-4819-b68c-4ff3809ef722 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:50.818174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:50.844945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca8c4d-d0d6-4f47-a7f0-f3c703b3b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:50.846159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca8c4d-d0d6-4f47-a7f0-f3c703b3b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.846440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca8c4d-d0d6-4f47-a7f0-f3c703b3b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.846711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca8c4d-d0d6-4f47-a7f0-f3c703b3b1b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.848772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:50.857717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca8c4d-d0d6-4f47-a7f0-f3c703b3b1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-5fca8c4d-d0d6-4f47-a7f0-f3c703b3b1b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:50.865919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:50.866817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:50.867600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 88/178] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:58:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:50.868413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca8c4d-d0d6-4f47-a7f0-f3c703b3b1b0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:50.870478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b587886-bcca-46b2-ba5f-998365147046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:50.872321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b587886-bcca-46b2-ba5f-998365147046 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:50.975628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca8c4d-d0d6-4f47-a7f0-f3c703b3b1b0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:50.982739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 91/179] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:50.984132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a106d-14d9-4117-b516-ac238d7ab23d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.984483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a106d-14d9-4117-b516-ac238d7ab23d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.984818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a106d-14d9-4117-b516-ac238d7ab23d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.993833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 92/180] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:50.993833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270aff6-3790-4d41-a6d8-99bf0e0e0bf5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:50.993833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270aff6-3790-4d41-a6d8-99bf0e0e0bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:50.993833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270aff6-3790-4d41-a6d8-99bf0e0e0bf5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:50.993833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 93/181] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:50.993833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270aff6-3790-4d41-a6d8-99bf0e0e0bf5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.019346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f063c3-dd18-40fe-a61c-ee84927f465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.020331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f063c3-dd18-40fe-a61c-ee84927f465b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.020676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f063c3-dd18-40fe-a61c-ee84927f465b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.020955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f063c3-dd18-40fe-a61c-ee84927f465b None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.022210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f063c3-dd18-40fe-a61c-ee84927f465b None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:51.023729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f063c3-dd18-40fe-a61c-ee84927f465b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:51.025457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 89/182] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:50 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:51.030037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f063c3-dd18-40fe-a61c-ee84927f465b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.063382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:51.089996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:51.108360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270aff6-3790-4d41-a6d8-99bf0e0e0bf5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.125279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f063c3-dd18-40fe-a61c-ee84927f465b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.141994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c5cec-ef73-48b0-a252-7d2c8e8d4680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.142662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5cec-ef73-48b0-a252-7d2c8e8d4680 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.142936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5cec-ef73-48b0-a252-7d2c8e8d4680 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.143207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c5cec-ef73-48b0-a252-7d2c8e8d4680 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.143948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c5cec-ef73-48b0-a252-7d2c8e8d4680 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:51.144246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c5cec-ef73-48b0-a252-7d2c8e8d4680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:51.145611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c5cec-ef73-48b0-a252-7d2c8e8d4680 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:51.153835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 94/183] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:58:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:51.154954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514432f-537b-4f57-be6e-6ae638f8cdbb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.155235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514432f-537b-4f57-be6e-6ae638f8cdbb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.155504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514432f-537b-4f57-be6e-6ae638f8cdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.164221 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9ec13-3702-4614-a182-2303468083a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.165133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ec13-3702-4614-a182-2303468083a2 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.165410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ec13-3702-4614-a182-2303468083a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.165681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ec13-3702-4614-a182-2303468083a2 None admin] PATH_INFO: `/v3/projects/6b21c416b5944fc39f6c45346b8a33da` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.166918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9ec13-3702-4614-a182-2303468083a2 None admin] RBAC: Authorizing `identity:get_project(project_id=6b21c416b5944fc39f6c45346b8a33da)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:51.168395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9ec13-3702-4614-a182-2303468083a2 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:51.170318 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 90/184] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:51 2022] GET /identity/v3/projects/6b21c416b5944fc39f6c45346b8a33da => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:51.171289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86437-19a5-4f12-982d-c3985e71604d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.171569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86437-19a5-4f12-982d-c3985e71604d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.171658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2514432f-537b-4f57-be6e-6ae638f8cdbb None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:51.171832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86437-19a5-4f12-982d-c3985e71604d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.172885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2514432f-537b-4f57-be6e-6ae638f8cdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:51.188331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-15a86437-19a5-4f12-982d-c3985e71604d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:51.189564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-15a86437-19a5-4f12-982d-c3985e71604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:51.239614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 95/185] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:51.246730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514432f-537b-4f57-be6e-6ae638f8cdbb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.254801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 91/186] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:51.256374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba543944-0295-4865-a1e6-ac36781c9cfe None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.256660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba543944-0295-4865-a1e6-ac36781c9cfe None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.256936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba543944-0295-4865-a1e6-ac36781c9cfe None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.261847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 92/187] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:51.261847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba543944-0295-4865-a1e6-ac36781c9cfe None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.298011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:51.335838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:51.360961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514432f-537b-4f57-be6e-6ae638f8cdbb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.364782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba543944-0295-4865-a1e6-ac36781c9cfe None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.393636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.394319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.394600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.394868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.395693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] RBAC: Adding query filter params (role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=a54cac18fe3448119899dcb53a77d938, user.id=f4a7349d4c204fb79a3e615178e43fa9) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:51.395999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:51.397556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:51.398425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fe214-ce91-4a52-9290-a07e2816e6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.399465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fe214-ce91-4a52-9290-a07e2816e6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.399747 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fe214-ce91-4a52-9290-a07e2816e6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.400046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fe214-ce91-4a52-9290-a07e2816e6f8 None admin] PATH_INFO: `/v3/users/f15db29e10cc4622a14b2a705f3bb3d4` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.403371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 96/188] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:51 2022] GET /identity/v3/role_assignments?user.id=f4a7349d4c204fb79a3e615178e43fa9&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=de3989d133584bab8378c170cee57ac6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:51.404159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.415979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fe214-ce91-4a52-9290-a07e2816e6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=f15db29e10cc4622a14b2a705f3bb3d4)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:51.417477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fe214-ce91-4a52-9290-a07e2816e6f8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:51.424339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 93/189] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:51 2022] GET /identity/v3/users/f15db29e10cc4622a14b2a705f3bb3d4 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:51.424339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ef67a-f236-454f-b25d-2d539a0b6942 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.424339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ef67a-f236-454f-b25d-2d539a0b6942 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.424339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ef67a-f236-454f-b25d-2d539a0b6942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.443230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-5e4ef67a-f236-454f-b25d-2d539a0b6942 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:51.445103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5e4ef67a-f236-454f-b25d-2d539a0b6942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:51.537824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 94/190] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:51.537824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ef67a-f236-454f-b25d-2d539a0b6942 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.538100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880fa26-609c-4768-973b-fced1cb7942e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.565664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:51.579569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.582708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.582990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.583268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.584129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] RBAC: Adding query filter params (role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=6b21c416b5944fc39f6c45346b8a33da, user.id=f4a7349d4c204fb79a3e615178e43fa9) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:51.584535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:51.587377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:51.595527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 97/191] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:51 2022] GET /identity/v3/role_assignments?user.id=f4a7349d4c204fb79a3e615178e43fa9&scope.project.id=6b21c416b5944fc39f6c45346b8a33da&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:51.595527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.626257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:51.709996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ef67a-f236-454f-b25d-2d539a0b6942 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.755492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68772d9-e269-4414-8340-4535b116822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.757320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68772d9-e269-4414-8340-4535b116822f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.757832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68772d9-e269-4414-8340-4535b116822f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.758780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68772d9-e269-4414-8340-4535b116822f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.760812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68772d9-e269-4414-8340-4535b116822f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:51.762908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68772d9-e269-4414-8340-4535b116822f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:51.764937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 95/192] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:51.765160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53c287-2410-4cc7-9162-2091327874f4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.766723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68772d9-e269-4414-8340-4535b116822f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.821878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee170a-7661-4551-b1c5-ace81dd67f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.822735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee170a-7661-4551-b1c5-ace81dd67f19 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.823010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee170a-7661-4551-b1c5-ace81dd67f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.823279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee170a-7661-4551-b1c5-ace81dd67f19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.839684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee170a-7661-4551-b1c5-ace81dd67f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-01ee170a-7661-4551-b1c5-ace81dd67f19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:51.848554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:51.851442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 98/193] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:51.852314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee170a-7661-4551-b1c5-ace81dd67f19 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:51.889397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:51.903520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68772d9-e269-4414-8340-4535b116822f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.922767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:51.937857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df98187-e2a1-418a-a042-46ad802b2ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.938532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98187-e2a1-418a-a042-46ad802b2ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.938810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98187-e2a1-418a-a042-46ad802b2ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.939082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98187-e2a1-418a-a042-46ad802b2ad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:51.963381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee170a-7661-4551-b1c5-ace81dd67f19 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:51.997313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35228bc9-d3e9-42c0-a9f0-b1234df84276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:51.998148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bc9-d3e9-42c0-a9f0-b1234df84276 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:51.998438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bc9-d3e9-42c0-a9f0-b1234df84276 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:51.998715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35228bc9-d3e9-42c0-a9f0-b1234df84276 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.008690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df98187-e2a1-418a-a042-46ad802b2ad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.009280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35228bc9-d3e9-42c0-a9f0-b1234df84276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:52.010331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df98187-e2a1-418a-a042-46ad802b2ad3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-35228bc9-d3e9-42c0-a9f0-b1234df84276 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:52.017021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:52.017927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:52.018730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 99/194] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:52.019380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35228bc9-d3e9-42c0-a9f0-b1234df84276 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.101583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:52.112448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 96/195] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:52.113258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df98187-e2a1-418a-a042-46ad802b2ad3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.123380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35228bc9-d3e9-42c0-a9f0-b1234df84276 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.146518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:52.158734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4e30e-9402-45d0-82bd-34faeaf27c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.159412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4e30e-9402-45d0-82bd-34faeaf27c0a None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.159697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4e30e-9402-45d0-82bd-34faeaf27c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.159974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4e30e-9402-45d0-82bd-34faeaf27c0a None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.160695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4e30e-9402-45d0-82bd-34faeaf27c0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.162194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4e30e-9402-45d0-82bd-34faeaf27c0a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:52.184595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 100/196] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:58:52 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:52.185419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4e30e-9402-45d0-82bd-34faeaf27c0a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.231196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df98187-e2a1-418a-a042-46ad802b2ad3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.271828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.273276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.273566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.273880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.274668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:52.274990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.276436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:52.285624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 97/197] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:52.286560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.311694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4e30e-9402-45d0-82bd-34faeaf27c0a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.345824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:52.356865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.357569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.357883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.358165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.358957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:52.359262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.360677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:52.371939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 101/198] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:52.372683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.406400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f483b-bbff-405c-bc5c-4bff9d3680c2 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.421648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:52.457983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869a3c2-709a-44c1-a82a-06f691c8fec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.460441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869a3c2-709a-44c1-a82a-06f691c8fec8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.460441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869a3c2-709a-44c1-a82a-06f691c8fec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.460441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869a3c2-709a-44c1-a82a-06f691c8fec8 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.460829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869a3c2-709a-44c1-a82a-06f691c8fec8 None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.464188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869a3c2-709a-44c1-a82a-06f691c8fec8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:52.464188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 98/199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:52 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:52.464788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869a3c2-709a-44c1-a82a-06f691c8fec8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.498658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af6fab-6500-4d0f-993d-029e3fc4ad50 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.542680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25409a-66da-45cc-a721-ac3e82537977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.544506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25409a-66da-45cc-a721-ac3e82537977 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.544959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25409a-66da-45cc-a721-ac3e82537977 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.545421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25409a-66da-45cc-a721-ac3e82537977 None admin] PATH_INFO: `/v3/users/f15db29e10cc4622a14b2a705f3bb3d4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.547063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25409a-66da-45cc-a721-ac3e82537977 None admin] RBAC: Authorizing `identity:get_user(user_id=f15db29e10cc4622a14b2a705f3bb3d4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.549267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25409a-66da-45cc-a721-ac3e82537977 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:52.552742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 102/200] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:52 2022] GET /identity/v3/users/f15db29e10cc4622a14b2a705f3bb3d4 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:52.553971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25409a-66da-45cc-a721-ac3e82537977 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.595429 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869a3c2-709a-44c1-a82a-06f691c8fec8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.622802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:52.642126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d8103-8b15-4f5c-ba21-72f52f9af3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.643018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d8103-8b15-4f5c-ba21-72f52f9af3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.643299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d8103-8b15-4f5c-ba21-72f52f9af3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.643573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d8103-8b15-4f5c-ba21-72f52f9af3d6 None admin] PATH_INFO: `/v3/users/e5d1244735ac4da088e5cde5621f3a66` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.644799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d8103-8b15-4f5c-ba21-72f52f9af3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=e5d1244735ac4da088e5cde5621f3a66)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.646930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d8103-8b15-4f5c-ba21-72f52f9af3d6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:52.653822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 99/201] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:52 2022] GET /identity/v3/users/e5d1244735ac4da088e5cde5621f3a66 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:52.653822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d8103-8b15-4f5c-ba21-72f52f9af3d6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.678821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25409a-66da-45cc-a721-ac3e82537977 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.693504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:52.724699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.725911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.726480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.726968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.727994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] RBAC: Adding query filter params (role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=5c75dc25d4a74e258aebc6a53b585817, user.id=f15db29e10cc4622a14b2a705f3bb3d4) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:52.728589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.730423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:52.737141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 103/202] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:52 2022] GET /identity/v3/role_assignments?user.id=f15db29e10cc4622a14b2a705f3bb3d4&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=de3989d133584bab8378c170cee57ac6 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:52.738669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:52.802220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d8103-8b15-4f5c-ba21-72f52f9af3d6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.853784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde040-b02f-4a30-897b-89d3aa56078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.854523 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde040-b02f-4a30-897b-89d3aa56078a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.854809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde040-b02f-4a30-897b-89d3aa56078a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.855085 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde040-b02f-4a30-897b-89d3aa56078a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.921498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3528c7-c7f3-4c74-9d5e-aa39ccdde119 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:52.957632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf051-57d5-462f-bb9e-2b88f83ae141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:52.958838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf051-57d5-462f-bb9e-2b88f83ae141 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:52.959412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf051-57d5-462f-bb9e-2b88f83ae141 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:52.959893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf051-57d5-462f-bb9e-2b88f83ae141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:52.969988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:52.996785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dde040-b02f-4a30-897b-89d3aa56078a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:52.998456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dde040-b02f-4a30-897b-89d3aa56078a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:53.005419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:53.044524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcf051-57d5-462f-bb9e-2b88f83ae141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:53.046384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcf051-57d5-462f-bb9e-2b88f83ae141 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:53.151178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 104/203] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:53.156956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf051-57d5-462f-bb9e-2b88f83ae141 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:53.194722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 100/204] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:53.200352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde040-b02f-4a30-897b-89d3aa56078a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:53.230158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:53.260258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf051-57d5-462f-bb9e-2b88f83ae141 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:53.305365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13667-cd07-4bf8-b022-f0e5f3eb620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:53.307387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13667-cd07-4bf8-b022-f0e5f3eb620a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:53.308523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13667-cd07-4bf8-b022-f0e5f3eb620a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:53.309185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13667-cd07-4bf8-b022-f0e5f3eb620a None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:53.311779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13667-cd07-4bf8-b022-f0e5f3eb620a None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:53.314216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13667-cd07-4bf8-b022-f0e5f3eb620a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:53.319557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 105/205] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:53 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:53.322595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13667-cd07-4bf8-b022-f0e5f3eb620a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:53.358030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:53.372033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde040-b02f-4a30-897b-89d3aa56078a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:53.411102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccf3f3-552a-4800-9866-d07010ebbecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:53.412791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf3f3-552a-4800-9866-d07010ebbecd None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:53.413296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf3f3-552a-4800-9866-d07010ebbecd None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:53.413859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf3f3-552a-4800-9866-d07010ebbecd None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:53.415306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf3f3-552a-4800-9866-d07010ebbecd None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:53.417014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf3f3-552a-4800-9866-d07010ebbecd None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:53.419933 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 101/206] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:53 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:53.428018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccf3f3-552a-4800-9866-d07010ebbecd None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:53.491473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13667-cd07-4bf8-b022-f0e5f3eb620a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:53.527614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb816d4-f89c-45e8-ba8e-34d8df97f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:53.528297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb816d4-f89c-45e8-ba8e-34d8df97f584 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:53.528574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb816d4-f89c-45e8-ba8e-34d8df97f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:53.528846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb816d4-f89c-45e8-ba8e-34d8df97f584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:53.529713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb816d4-f89c-45e8-ba8e-34d8df97f584 None admin] RBAC: Adding query filter params (role.id=2affecf7dda148d6a834671d7fa0ef8d, scope.project.id=a54cac18fe3448119899dcb53a77d938, user.id=e5d1244735ac4da088e5cde5621f3a66) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:53.530175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb816d4-f89c-45e8-ba8e-34d8df97f584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:53.531703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb816d4-f89c-45e8-ba8e-34d8df97f584 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:53.538614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 106/207] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:53 2022] GET /identity/v3/role_assignments?user.id=e5d1244735ac4da088e5cde5621f3a66&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=2affecf7dda148d6a834671d7fa0ef8d => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:53.609514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccf3f3-552a-4800-9866-d07010ebbecd None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:53.647142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efcb08-4f4d-4aa7-9435-62b728444325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:53.648236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb08-4f4d-4aa7-9435-62b728444325 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:53.648708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb08-4f4d-4aa7-9435-62b728444325 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:53.649170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb08-4f4d-4aa7-9435-62b728444325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:53.650238 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efcb08-4f4d-4aa7-9435-62b728444325 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=5c75dc25d4a74e258aebc6a53b585817, user.id=f15db29e10cc4622a14b2a705f3bb3d4) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:53.650816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efcb08-4f4d-4aa7-9435-62b728444325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:53.652493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efcb08-4f4d-4aa7-9435-62b728444325 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:53.659411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 102/208] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:53 2022] GET /identity/v3/role_assignments?user.id=f15db29e10cc4622a14b2a705f3bb3d4&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:54.524083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876685d-667e-49cc-be52-b799509f686e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:54.524651 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876685d-667e-49cc-be52-b799509f686e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:54.524935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876685d-667e-49cc-be52-b799509f686e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:54.526497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 107/209] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:54.532250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de870f-94c8-46a1-9d74-d8974390c41b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:54.532662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de870f-94c8-46a1-9d74-d8974390c41b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:54.532850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de870f-94c8-46a1-9d74-d8974390c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:54.550481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-27de870f-94c8-46a1-9d74-d8974390c41b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:54.551680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-27de870f-94c8-46a1-9d74-d8974390c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:54.567115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:54.631695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 103/210] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:54.655395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876685d-667e-49cc-be52-b799509f686e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:54.658330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4c2e-5aae-4941-989b-60f49e4a2b13 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:54.658616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4c2e-5aae-4941-989b-60f49e4a2b13 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:54.658892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf4c2e-5aae-4941-989b-60f49e4a2b13 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:54.660620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 104/211] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:58:54.660897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:54.666082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fdee-3a8d-48ba-baf7-e4943e93e0cd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:54.666366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fdee-3a8d-48ba-baf7-e4943e93e0cd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:54.666650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fdee-3a8d-48ba-baf7-e4943e93e0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:54.684910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b478fdee-3a8d-48ba-baf7-e4943e93e0cd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:54.686708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b478fdee-3a8d-48ba-baf7-e4943e93e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:54.776408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876685d-667e-49cc-be52-b799509f686e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:54.778406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:54.803121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478fdee-3a8d-48ba-baf7-e4943e93e0cd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:54.816640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa7b0-d600-42ab-9ef0-1a4afd205687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:54.817458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa7b0-d600-42ab-9ef0-1a4afd205687 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:54.817739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa7b0-d600-42ab-9ef0-1a4afd205687 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:54.818073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa7b0-d600-42ab-9ef0-1a4afd205687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:54.833045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fa7b0-d600-42ab-9ef0-1a4afd205687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b32fa7b0-d600-42ab-9ef0-1a4afd205687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:54.843819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:54.844753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:54.845557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:54.851089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa7b0-d600-42ab-9ef0-1a4afd205687 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:54.892648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:54.916233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:54.917022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478fdee-3a8d-48ba-baf7-e4943e93e0cd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:54.955197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb83f-ed46-45d0-b8e9-48b76589b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:54.956922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb83f-ed46-45d0-b8e9-48b76589b42b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:54.957513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb83f-ed46-45d0-b8e9-48b76589b42b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:54.958069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb83f-ed46-45d0-b8e9-48b76589b42b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:54.959701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdb83f-ed46-45d0-b8e9-48b76589b42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:54.959977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa7b0-d600-42ab-9ef0-1a4afd205687 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:54.961687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdb83f-ed46-45d0-b8e9-48b76589b42b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:54.969313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:54.970233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb83f-ed46-45d0-b8e9-48b76589b42b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.001139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fad416-6f30-48f5-8443-31a1b53edbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:55.001834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad416-6f30-48f5-8443-31a1b53edbcd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.002113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad416-6f30-48f5-8443-31a1b53edbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.002391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad416-6f30-48f5-8443-31a1b53edbcd None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.003140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fad416-6f30-48f5-8443-31a1b53edbcd None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:55.003444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fad416-6f30-48f5-8443-31a1b53edbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:55.004821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fad416-6f30-48f5-8443-31a1b53edbcd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:55.013186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 109/215] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:55.022209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d414e-9bfa-4883-a272-7218d069b4ea None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.022209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d414e-9bfa-4883-a272-7218d069b4ea None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.022209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d414e-9bfa-4883-a272-7218d069b4ea None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.022209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 110/216] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:55.022209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d414e-9bfa-4883-a272-7218d069b4ea None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.082675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb83f-ed46-45d0-b8e9-48b76589b42b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:55.118295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308407b-1bac-4b49-8ade-823d1a19f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:55.118949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308407b-1bac-4b49-8ade-823d1a19f489 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.119208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308407b-1bac-4b49-8ade-823d1a19f489 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.119476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308407b-1bac-4b49-8ade-823d1a19f489 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.120227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308407b-1bac-4b49-8ade-823d1a19f489 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:55.121963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308407b-1bac-4b49-8ade-823d1a19f489 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:55.127828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d414e-9bfa-4883-a272-7218d069b4ea None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:55.150203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 107/217] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:58:54 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:58:55.151610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb0c4-b292-4efd-b480-bf0f5bab7432 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.151896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb0c4-b292-4efd-b480-bf0f5bab7432 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.152217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb0c4-b292-4efd-b480-bf0f5bab7432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.158325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:55.164642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:55.172858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-60ccb0c4-b292-4efd-b480-bf0f5bab7432 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:55.174185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-60ccb0c4-b292-4efd-b480-bf0f5bab7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:55.177193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3917a94-0419-4495-8cdd-dd541f59b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:55.178483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3917a94-0419-4495-8cdd-dd541f59b480 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.178965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3917a94-0419-4495-8cdd-dd541f59b480 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.179431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3917a94-0419-4495-8cdd-dd541f59b480 None admin] PATH_INFO: `/v3/users/6e55a90f1a7d441c9009a95b82ce2600` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.195927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3917a94-0419-4495-8cdd-dd541f59b480 None admin] RBAC: Authorizing `identity:get_user(user_id=6e55a90f1a7d441c9009a95b82ce2600)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:55.197866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3917a94-0419-4495-8cdd-dd541f59b480 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:55.200313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 111/218] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:55 2022] GET /identity/v3/users/6e55a90f1a7d441c9009a95b82ce2600 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:55.206134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3917a94-0419-4495-8cdd-dd541f59b480 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.253820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 108/219] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:55.271327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccb0c4-b292-4efd-b480-bf0f5bab7432 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.349540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3917a94-0419-4495-8cdd-dd541f59b480 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:55.388506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203ace5-3da7-453f-94de-fba2a4a36586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:55.389170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ace5-3da7-453f-94de-fba2a4a36586 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.389445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ace5-3da7-453f-94de-fba2a4a36586 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.389718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ace5-3da7-453f-94de-fba2a4a36586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.402809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccb0c4-b292-4efd-b480-bf0f5bab7432 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:55.446200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0057e-2ca4-4b56-b1fc-28fc64d35843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:55.447146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0057e-2ca4-4b56-b1fc-28fc64d35843 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.447433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0057e-2ca4-4b56-b1fc-28fc64d35843 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.447902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0057e-2ca4-4b56-b1fc-28fc64d35843 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.450083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:55.452734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:55.464697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0057e-2ca4-4b56-b1fc-28fc64d35843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e4a0057e-2ca4-4b56-b1fc-28fc64d35843 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:55.473917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:55.474961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:55.475862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 109/220] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:58:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:58:55.481612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203ace5-3da7-453f-94de-fba2a4a36586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:55.481752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0057e-2ca4-4b56-b1fc-28fc64d35843 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.483391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203ace5-3da7-453f-94de-fba2a4a36586 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:55.605660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0057e-2ca4-4b56-b1fc-28fc64d35843 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:55.617818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 112/221] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:55.622655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203ace5-3da7-453f-94de-fba2a4a36586 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.647563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:55.648423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.648720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.648979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.649828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:55.650141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:55.651730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:55.661654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 110/222] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:58:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:55.667680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.729194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:55.730407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:55.741975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203ace5-3da7-453f-94de-fba2a4a36586 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:55.779326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b6be-3fd9-43fe-84aa-ba92c89a8113 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:55.780680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d882ba-2d4f-4756-9728-ed2c97724173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:55.781785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d882ba-2d4f-4756-9728-ed2c97724173 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.782284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d882ba-2d4f-4756-9728-ed2c97724173 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.782744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d882ba-2d4f-4756-9728-ed2c97724173 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.784201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d882ba-2d4f-4756-9728-ed2c97724173 None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:55.785906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d882ba-2d4f-4756-9728-ed2c97724173 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:55.788027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 113/223] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:55 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:55.798771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d882ba-2d4f-4756-9728-ed2c97724173 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.836824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620c910-83d0-4da4-a968-1bccbdbf3eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:55.837772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c910-83d0-4da4-a968-1bccbdbf3eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:55.838096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c910-83d0-4da4-a968-1bccbdbf3eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:55.838369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620c910-83d0-4da4-a968-1bccbdbf3eb9 None admin] PATH_INFO: `/v3/users/f15db29e10cc4622a14b2a705f3bb3d4` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:55.839713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620c910-83d0-4da4-a968-1bccbdbf3eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=f15db29e10cc4622a14b2a705f3bb3d4)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:55.841909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620c910-83d0-4da4-a968-1bccbdbf3eb9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:55.843918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 111/224] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:55 2022] GET /identity/v3/users/f15db29e10cc4622a14b2a705f3bb3d4 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:55.849431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620c910-83d0-4da4-a968-1bccbdbf3eb9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:55.968566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d882ba-2d4f-4756-9728-ed2c97724173 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:55.974611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620c910-83d0-4da4-a968-1bccbdbf3eb9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:56.006625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:56.009205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa4cc7-488b-458a-a110-7afb545fe1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:56.009911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa4cc7-488b-458a-a110-7afb545fe1bb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.010187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa4cc7-488b-458a-a110-7afb545fe1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.010460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa4cc7-488b-458a-a110-7afb545fe1bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.011308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa4cc7-488b-458a-a110-7afb545fe1bb None admin] RBAC: Adding query filter params (role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=5c75dc25d4a74e258aebc6a53b585817, user.id=6e55a90f1a7d441c9009a95b82ce2600) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:56.011618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa4cc7-488b-458a-a110-7afb545fe1bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:56.014284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa4cc7-488b-458a-a110-7afb545fe1bb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:56.020437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 114/225] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:55 2022] GET /identity/v3/role_assignments?user.id=6e55a90f1a7d441c9009a95b82ce2600&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:56.025820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2cfb1-0010-451d-9f1d-698172b16010 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.025820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2cfb1-0010-451d-9f1d-698172b16010 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.025820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2cfb1-0010-451d-9f1d-698172b16010 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.025820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 115/226] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:56.029286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf80b-8ef2-4991-88a7-336a2ef9b5ef None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.029560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf80b-8ef2-4991-88a7-336a2ef9b5ef None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.029861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf80b-8ef2-4991-88a7-336a2ef9b5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.032147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6ee98-7e4c-476e-a1d0-a889ccefaa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:56.033320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ee98-7e4c-476e-a1d0-a889ccefaa7f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.033868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ee98-7e4c-476e-a1d0-a889ccefaa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.034322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ee98-7e4c-476e-a1d0-a889ccefaa7f None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.038701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6ee98-7e4c-476e-a1d0-a889ccefaa7f None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:56.040487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6ee98-7e4c-476e-a1d0-a889ccefaa7f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:56.042807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 112/227] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:55 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:56.048650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6ee98-7e4c-476e-a1d0-a889ccefaa7f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:56.048804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-710bf80b-8ef2-4991-88a7-336a2ef9b5ef None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:56.050101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-710bf80b-8ef2-4991-88a7-336a2ef9b5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:56.063331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:56.124253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 116/228] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:56.148102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bf80b-8ef2-4991-88a7-336a2ef9b5ef None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:56.159767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6ee98-7e4c-476e-a1d0-a889ccefaa7f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:56.196643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ed7db-f043-4ecb-a2b1-02eee84ebe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:56.198013 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed7db-f043-4ecb-a2b1-02eee84ebe00 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.198490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed7db-f043-4ecb-a2b1-02eee84ebe00 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.198951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed7db-f043-4ecb-a2b1-02eee84ebe00 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817/users/f15db29e10cc4622a14b2a705f3bb3d4/roles/de3989d133584bab8378c170cee57ac6` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.201496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ed7db-f043-4ecb-a2b1-02eee84ebe00 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c75dc25d4a74e258aebc6a53b585817, user_id=f15db29e10cc4622a14b2a705f3bb3d4, role_id=de3989d133584bab8378c170cee57ac6)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:56.203631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ed7db-f043-4ecb-a2b1-02eee84ebe00 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:56.222430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 113/229] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:58:56 2022] PUT /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817/users/f15db29e10cc4622a14b2a705f3bb3d4/roles/de3989d133584bab8378c170cee57ac6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:58:56.273776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bf80b-8ef2-4991-88a7-336a2ef9b5ef None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:56.324216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea20a5b-1635-4925-b656-182e129862fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:56.325071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea20a5b-1635-4925-b656-182e129862fa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.325351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea20a5b-1635-4925-b656-182e129862fa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.325625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea20a5b-1635-4925-b656-182e129862fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.346839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea20a5b-1635-4925-b656-182e129862fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-2ea20a5b-1635-4925-b656-182e129862fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:56.355005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:56.355956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:56.356758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 117/230] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:58:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:56.363386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ed7db-f043-4ecb-a2b1-02eee84ebe00 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:56.447818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:56.498077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ed7db-f043-4ecb-a2b1-02eee84ebe00 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:56.533040 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:56.534144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.534641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.535101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.536041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:56.536534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:56.538384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:56.547675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 114/231] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:56.553400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea20a5b-1635-4925-b656-182e129862fa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:56.571635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:56.693678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea20a5b-1635-4925-b656-182e129862fa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:56.744801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8e392-2e84-4f50-aee0-f57fc0d10315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:56.745695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8e392-2e84-4f50-aee0-f57fc0d10315 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.746000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8e392-2e84-4f50-aee0-f57fc0d10315 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.746279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8e392-2e84-4f50-aee0-f57fc0d10315 None admin] PATH_INFO: `/v3/users/f15db29e10cc4622a14b2a705f3bb3d4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.747513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8e392-2e84-4f50-aee0-f57fc0d10315 None admin] RBAC: Authorizing `identity:get_user(user_id=f15db29e10cc4622a14b2a705f3bb3d4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:56.749040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8e392-2e84-4f50-aee0-f57fc0d10315 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:56.750839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 118/232] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:56 2022] GET /identity/v3/users/f15db29e10cc4622a14b2a705f3bb3d4 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:56.756349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:56.879539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf8944-824f-4e60-8e03-4e1a702e0dc4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:56.893978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:56.924710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d677b-f778-47af-95d9-3669b6029919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:56.925593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d677b-f778-47af-95d9-3669b6029919 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:56.925897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d677b-f778-47af-95d9-3669b6029919 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:56.926166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d677b-f778-47af-95d9-3669b6029919 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:56.927360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d677b-f778-47af-95d9-3669b6029919 None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:56.928864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d677b-f778-47af-95d9-3669b6029919 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:56.930720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 115/233] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:56 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:56.938908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8e392-2e84-4f50-aee0-f57fc0d10315 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:57.031458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:57.057890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8e392-2e84-4f50-aee0-f57fc0d10315 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:57.094885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72437ab4-98d8-4dbe-93bc-90aa271b71c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:57.095803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437ab4-98d8-4dbe-93bc-90aa271b71c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:57.096082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437ab4-98d8-4dbe-93bc-90aa271b71c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:57.096356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437ab4-98d8-4dbe-93bc-90aa271b71c2 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817/users/f15db29e10cc4622a14b2a705f3bb3d4/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:57.098394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72437ab4-98d8-4dbe-93bc-90aa271b71c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c75dc25d4a74e258aebc6a53b585817, user_id=f15db29e10cc4622a14b2a705f3bb3d4, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:57.099902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72437ab4-98d8-4dbe-93bc-90aa271b71c2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:57.121064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 119/234] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:58:56 2022] PUT /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817/users/f15db29e10cc4622a14b2a705f3bb3d4/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:58:57.711485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a444-c65d-4739-8404-634eaeaba94d None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:57.711768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a444-c65d-4739-8404-634eaeaba94d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:57.712297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a444-c65d-4739-8404-634eaeaba94d None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:57.713920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 116/235] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:57.719448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe565b-5bef-469b-86bc-b3008b58b0af None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:57.720294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe565b-5bef-469b-86bc-b3008b58b0af None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:57.720767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe565b-5bef-469b-86bc-b3008b58b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:57.738250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-32fe565b-5bef-469b-86bc-b3008b58b0af None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:57.739773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-32fe565b-5bef-469b-86bc-b3008b58b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:57.811611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 120/236] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:57.835654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a444-c65d-4739-8404-634eaeaba94d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:57.944891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a444-c65d-4739-8404-634eaeaba94d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:57.980441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747bc09-f7f6-4394-91b7-801d0a0730ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:57.981263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747bc09-f7f6-4394-91b7-801d0a0730ff None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:57.981542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747bc09-f7f6-4394-91b7-801d0a0730ff None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:57.981824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747bc09-f7f6-4394-91b7-801d0a0730ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:57.992650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747bc09-f7f6-4394-91b7-801d0a0730ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4747bc09-f7f6-4394-91b7-801d0a0730ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:58.000399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:58.001338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:58:58.002199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 117/237] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:58.009313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe565b-5bef-469b-86bc-b3008b58b0af None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:58.094343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:58.133202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe565b-5bef-469b-86bc-b3008b58b0af None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:58.167632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6198cad-17ab-4131-b3f3-7e012c0d1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:58.168319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6198cad-17ab-4131-b3f3-7e012c0d1318 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.168599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6198cad-17ab-4131-b3f3-7e012c0d1318 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.168874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6198cad-17ab-4131-b3f3-7e012c0d1318 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.169636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6198cad-17ab-4131-b3f3-7e012c0d1318 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:58.169974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6198cad-17ab-4131-b3f3-7e012c0d1318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:58.171426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6198cad-17ab-4131-b3f3-7e012c0d1318 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:58.180247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 121/238] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:58.185955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747bc09-f7f6-4394-91b7-801d0a0730ff None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:58.236543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:58.270589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538554d6-5e76-4840-bbbe-19ede2576cf9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.270911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538554d6-5e76-4840-bbbe-19ede2576cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.271145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538554d6-5e76-4840-bbbe-19ede2576cf9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.272851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 122/239] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:58:58.277709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2dbbd-20c5-4c2d-a366-ac5116e12c80 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.278033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2dbbd-20c5-4c2d-a366-ac5116e12c80 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.278310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2dbbd-20c5-4c2d-a366-ac5116e12c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.304927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-40e2dbbd-20c5-4c2d-a366-ac5116e12c80 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:58.306154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-40e2dbbd-20c5-4c2d-a366-ac5116e12c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:58.351026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747bc09-f7f6-4394-91b7-801d0a0730ff None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:58.407137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0874c86-49b3-4a95-bde1-ff92fb79e008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:58.408044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874c86-49b3-4a95-bde1-ff92fb79e008 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.408331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874c86-49b3-4a95-bde1-ff92fb79e008 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.408604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874c86-49b3-4a95-bde1-ff92fb79e008 None admin] PATH_INFO: `/v3/users/7430c6e8eb6c4b57ba323be4eed51ded` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.416184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 123/240] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:58:58.436311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0874c86-49b3-4a95-bde1-ff92fb79e008 None admin] RBAC: Authorizing `identity:get_user(user_id=7430c6e8eb6c4b57ba323be4eed51ded)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:58.438169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0874c86-49b3-4a95-bde1-ff92fb79e008 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:58.441209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2dbbd-20c5-4c2d-a366-ac5116e12c80 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:58.445900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 118/241] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:58 2022] GET /identity/v3/users/7430c6e8eb6c4b57ba323be4eed51ded => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:58.456432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0874c86-49b3-4a95-bde1-ff92fb79e008 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:58.525676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:58.605561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2dbbd-20c5-4c2d-a366-ac5116e12c80 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:58.631654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:58.634928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0874c86-49b3-4a95-bde1-ff92fb79e008 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:58.661096 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d00e-b904-4190-a869-5b8a92e1850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:58.662602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d00e-b904-4190-a869-5b8a92e1850e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.663263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d00e-b904-4190-a869-5b8a92e1850e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.663367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d00e-b904-4190-a869-5b8a92e1850e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.664760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37d00e-b904-4190-a869-5b8a92e1850e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:58.666921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37d00e-b904-4190-a869-5b8a92e1850e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:58.669891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 124/242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:58.671553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e9ea-f520-4add-b80b-d84ff792f692 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.671830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e9ea-f520-4add-b80b-d84ff792f692 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.672101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5e9ea-f520-4add-b80b-d84ff792f692 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.673967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 125/243] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:58.675168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e9ea-f520-4add-b80b-d84ff792f692 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:58.683958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe6b15-98c2-4478-9d69-3470ce9093d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:58.684632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6b15-98c2-4478-9d69-3470ce9093d6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.684905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6b15-98c2-4478-9d69-3470ce9093d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.685183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe6b15-98c2-4478-9d69-3470ce9093d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.766799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6b15-98c2-4478-9d69-3470ce9093d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:58.768455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe6b15-98c2-4478-9d69-3470ce9093d6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:58.814744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5e9ea-f520-4add-b80b-d84ff792f692 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:58.847392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:58.862474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2469-3801-4ad6-ac4a-639072dd3989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:58.863598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2469-3801-4ad6-ac4a-639072dd3989 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.864018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2469-3801-4ad6-ac4a-639072dd3989 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.864841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2469-3801-4ad6-ac4a-639072dd3989 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.866052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e2469-3801-4ad6-ac4a-639072dd3989 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:58.868283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e2469-3801-4ad6-ac4a-639072dd3989 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:58.871084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:58.878778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 119/244] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:58:58.880977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec24c-f26d-4113-888d-841d67cdb5da None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.881517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec24c-f26d-4113-888d-841d67cdb5da None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.882309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ec24c-f26d-4113-888d-841d67cdb5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:58.899407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 126/245] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:58:58 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:58:58.900477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2469-3801-4ad6-ac4a-639072dd3989 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:58.903138 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b99ec24c-f26d-4113-888d-841d67cdb5da None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:58.904581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b99ec24c-f26d-4113-888d-841d67cdb5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:58.996959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 120/246] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:58.998833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b2ba-5255-4a39-aed4-cd419c87dba8 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:58.999285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b2ba-5255-4a39-aed4-cd419c87dba8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:58.999712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b2ba-5255-4a39-aed4-cd419c87dba8 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.001300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 121/247] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:59.007524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dbf4e-15ef-4dfc-aa31-835b84e41c8a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.008054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dbf4e-15ef-4dfc-aa31-835b84e41c8a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.008500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dbf4e-15ef-4dfc-aa31-835b84e41c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.037199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-507dbf4e-15ef-4dfc-aa31-835b84e41c8a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:59.039210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-507dbf4e-15ef-4dfc-aa31-835b84e41c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:58:59.068287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2469-3801-4ad6-ac4a-639072dd3989 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:59.112947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b8d2d-24bd-4d2c-896c-9fbe2b833bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:59.113858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b8d2d-24bd-4d2c-896c-9fbe2b833bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.114139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b8d2d-24bd-4d2c-896c-9fbe2b833bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.114409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b8d2d-24bd-4d2c-896c-9fbe2b833bb9 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.115770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b8d2d-24bd-4d2c-896c-9fbe2b833bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:59.117443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b8d2d-24bd-4d2c-896c-9fbe2b833bb9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:59.119376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 127/248] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:58:58 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:59.120058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b8d2d-24bd-4d2c-896c-9fbe2b833bb9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:59.126700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 122/249] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:58:59.127732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dbf4e-15ef-4dfc-aa31-835b84e41c8a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:59.177555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:59.203417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:59.239439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b8d2d-24bd-4d2c-896c-9fbe2b833bb9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:59.256914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dbf4e-15ef-4dfc-aa31-835b84e41c8a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:59.281988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec718e0-43c9-473a-8911-d7c5d9119275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:59.283137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec718e0-43c9-473a-8911-d7c5d9119275 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.283599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec718e0-43c9-473a-8911-d7c5d9119275 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.284041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec718e0-43c9-473a-8911-d7c5d9119275 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.297146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec718e0-43c9-473a-8911-d7c5d9119275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:59.298754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:59.299442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.299728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.300013 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.300873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] RBAC: Adding query filter params (role.id=2affecf7dda148d6a834671d7fa0ef8d, scope.project.id=5c75dc25d4a74e258aebc6a53b585817, user.id=7430c6e8eb6c4b57ba323be4eed51ded) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:59.301194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:59.302756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7ec718e0-43c9-473a-8911-d7c5d9119275 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:59.308009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:59.309190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 128/250] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:58:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:59.310304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec718e0-43c9-473a-8911-d7c5d9119275 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:59.313000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 123/251] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:58:59 2022] GET /identity/v3/role_assignments?user.id=7430c6e8eb6c4b57ba323be4eed51ded&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=2affecf7dda148d6a834671d7fa0ef8d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:59.316629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:59.490084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec718e0-43c9-473a-8911-d7c5d9119275 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:59.515568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ddba-2ae7-42ed-b652-0308c225917e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:59.521502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:59.536310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f4a65-4cb3-41e9-a007-663d15aee4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:59.537349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f4a65-4cb3-41e9-a007-663d15aee4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.537630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f4a65-4cb3-41e9-a007-663d15aee4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.538159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f4a65-4cb3-41e9-a007-663d15aee4a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.550363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:59.560834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f4a65-4cb3-41e9-a007-663d15aee4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b04f4a65-4cb3-41e9-a007-663d15aee4a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:58:59.571147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:58:59.572069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:58:59.573022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 129/252] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:58:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:58:59.580229 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f4a65-4cb3-41e9-a007-663d15aee4a7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:59.584750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:59.585554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.585869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.586152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.586921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:59.587234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:59.588669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:59.602817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 124/253] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:58:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:59.608762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:59.732000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f4a65-4cb3-41e9-a007-663d15aee4a7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:59.809003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd2d2b-1a0f-41b5-8e5a-604fdecc0cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:59.810620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2d2b-1a0f-41b5-8e5a-604fdecc0cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.811101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2d2b-1a0f-41b5-8e5a-604fdecc0cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.811566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd2d2b-1a0f-41b5-8e5a-604fdecc0cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.812545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd2d2b-1a0f-41b5-8e5a-604fdecc0cc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:58:59.813038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd2d2b-1a0f-41b5-8e5a-604fdecc0cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:59.814780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd2d2b-1a0f-41b5-8e5a-604fdecc0cc7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:59.825431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 130/254] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:58:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:58:59.827832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907dfc-4dd3-41c3-9453-bc8e547d1d05 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.828373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907dfc-4dd3-41c3-9453-bc8e547d1d05 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.828835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907dfc-4dd3-41c3-9453-bc8e547d1d05 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.830834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 131/255] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:58:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:58:59.838884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907dfc-4dd3-41c3-9453-bc8e547d1d05 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:58:59.859199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0d91e-8715-4327-8f60-11ce7c0808b9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:58:59.890041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:58:59.927865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e9fd6-8dfa-4c6a-8502-db4df1634ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:58:59.929523 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9fd6-8dfa-4c6a-8502-db4df1634ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.930042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9fd6-8dfa-4c6a-8502-db4df1634ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.930563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9fd6-8dfa-4c6a-8502-db4df1634ef3 None admin] PATH_INFO: `/v3/users/6e55a90f1a7d441c9009a95b82ce2600` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.931995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e9fd6-8dfa-4c6a-8502-db4df1634ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=6e55a90f1a7d441c9009a95b82ce2600)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:58:59.936122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e9fd6-8dfa-4c6a-8502-db4df1634ef3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:58:59.939707 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 125/256] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:59 2022] GET /identity/v3/users/6e55a90f1a7d441c9009a95b82ce2600 => generated 297 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:58:59.942359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976370a-bd5c-489c-87df-310b98dd0252 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:58:59.942685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976370a-bd5c-489c-87df-310b98dd0252 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:58:59.942968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976370a-bd5c-489c-87df-310b98dd0252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:58:59.972721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d976370a-bd5c-489c-87df-310b98dd0252 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:58:59.974230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d976370a-bd5c-489c-87df-310b98dd0252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:00.011180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907dfc-4dd3-41c3-9453-bc8e547d1d05 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:00.037673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:00.052607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 126/257] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:00.054182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976370a-bd5c-489c-87df-310b98dd0252 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:00.072531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb63ba-0596-4f0a-ad25-43c6cbd12e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:00.073688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb63ba-0596-4f0a-ad25-43c6cbd12e4b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:00.073827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb63ba-0596-4f0a-ad25-43c6cbd12e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:00.074149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb63ba-0596-4f0a-ad25-43c6cbd12e4b None admin] PATH_INFO: `/v3/users/f15db29e10cc4622a14b2a705f3bb3d4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:00.075512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb63ba-0596-4f0a-ad25-43c6cbd12e4b None admin] RBAC: Authorizing `identity:get_user(user_id=f15db29e10cc4622a14b2a705f3bb3d4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:00.082301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb63ba-0596-4f0a-ad25-43c6cbd12e4b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:00.084701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 132/258] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:58:59 2022] GET /identity/v3/users/f15db29e10cc4622a14b2a705f3bb3d4 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:00.090623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb63ba-0596-4f0a-ad25-43c6cbd12e4b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:00.166700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976370a-bd5c-489c-87df-310b98dd0252 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:00.204035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b1c46-69cc-4f5f-a642-38a61f56992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:00.205523 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1c46-69cc-4f5f-a642-38a61f56992f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:00.205996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1c46-69cc-4f5f-a642-38a61f56992f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:00.206435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1c46-69cc-4f5f-a642-38a61f56992f None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:00.207779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b1c46-69cc-4f5f-a642-38a61f56992f None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:00.209964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b1c46-69cc-4f5f-a642-38a61f56992f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:00.212522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 127/259] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:00 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:00.213763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b1c46-69cc-4f5f-a642-38a61f56992f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:00.275929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:00.321771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b1c46-69cc-4f5f-a642-38a61f56992f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:00.322231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:00.343909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb63ba-0596-4f0a-ad25-43c6cbd12e4b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:00.359050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232770f-e2e6-466c-900a-51c553a8bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:00.360152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232770f-e2e6-466c-900a-51c553a8bc3f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:00.360603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232770f-e2e6-466c-900a-51c553a8bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:00.361071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232770f-e2e6-466c-900a-51c553a8bc3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:00.372632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232770f-e2e6-466c-900a-51c553a8bc3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4232770f-e2e6-466c-900a-51c553a8bc3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:00.380850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:00.381945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:00.382745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:00.385190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 128/260] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:00.389882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232770f-e2e6-466c-900a-51c553a8bc3f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:00.471548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb228ce0-9e46-441d-88d4-fb5e0f57cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:00.472250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb228ce0-9e46-441d-88d4-fb5e0f57cd6e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:00.472537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb228ce0-9e46-441d-88d4-fb5e0f57cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:00.472815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb228ce0-9e46-441d-88d4-fb5e0f57cd6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:00.526619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232770f-e2e6-466c-900a-51c553a8bc3f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:00.551753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb228ce0-9e46-441d-88d4-fb5e0f57cd6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:00.553594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb228ce0-9e46-441d-88d4-fb5e0f57cd6e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:00.558130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:00.612227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65dd8e-992b-4ff7-a68c-e8e23828261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:00.613936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65dd8e-992b-4ff7-a68c-e8e23828261d None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:00.614436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65dd8e-992b-4ff7-a68c-e8e23828261d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:00.614909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65dd8e-992b-4ff7-a68c-e8e23828261d None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817/users/6e55a90f1a7d441c9009a95b82ce2600/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:00.617211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65dd8e-992b-4ff7-a68c-e8e23828261d None admin] RBAC: Authorizing `identity:create_grant(project_id=5c75dc25d4a74e258aebc6a53b585817, user_id=6e55a90f1a7d441c9009a95b82ce2600, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:00.619181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65dd8e-992b-4ff7-a68c-e8e23828261d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:00.637837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 129/261] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:59:00 2022] PUT /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817/users/6e55a90f1a7d441c9009a95b82ce2600/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:00.639507 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65dd8e-992b-4ff7-a68c-e8e23828261d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:00.731822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:00.746060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 133/262] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 16:59:00.749746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb228ce0-9e46-441d-88d4-fb5e0f57cd6e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:00.836569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65dd8e-992b-4ff7-a68c-e8e23828261d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:00.931303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:00.931904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:00.932181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:00.932457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:00.933224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:00.933531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:00.934983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:00.938305 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb228ce0-9e46-441d-88d4-fb5e0f57cd6e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:00.957109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 130/263] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:00.963222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:01.004550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7eedc-3048-4f3c-8f05-cc796e332f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:01.005501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7eedc-3048-4f3c-8f05-cc796e332f2b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:01.005800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7eedc-3048-4f3c-8f05-cc796e332f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:01.006120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7eedc-3048-4f3c-8f05-cc796e332f2b None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:01.007506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7eedc-3048-4f3c-8f05-cc796e332f2b None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:01.008992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7eedc-3048-4f3c-8f05-cc796e332f2b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:01.010939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 134/264] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:00 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:01.020510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7eedc-3048-4f3c-8f05-cc796e332f2b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:01.032806 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:01.126857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:01.142444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f7704-9f16-4d31-9c8b-e752341fb6c8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:01.184916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7eedc-3048-4f3c-8f05-cc796e332f2b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:01.189934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bce5-6d21-4b8b-ad37-919a73624d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:01.190837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bce5-6d21-4b8b-ad37-919a73624d3e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:01.191118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bce5-6d21-4b8b-ad37-919a73624d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:01.191390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bce5-6d21-4b8b-ad37-919a73624d3e None admin] PATH_INFO: `/v3/users/f15db29e10cc4622a14b2a705f3bb3d4` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:01.198238 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73bce5-6d21-4b8b-ad37-919a73624d3e None admin] RBAC: Authorizing `identity:get_user(user_id=f15db29e10cc4622a14b2a705f3bb3d4)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:01.199853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73bce5-6d21-4b8b-ad37-919a73624d3e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:01.201880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 131/265] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:00 2022] GET /identity/v3/users/f15db29e10cc4622a14b2a705f3bb3d4 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:01.208499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bce5-6d21-4b8b-ad37-919a73624d3e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:01.256512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:01.257405 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:01.257691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:01.258002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:01.259708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] RBAC: Adding query filter params (role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=5c75dc25d4a74e258aebc6a53b585817, user.id=f15db29e10cc4622a14b2a705f3bb3d4) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:01.260026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:01.262310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:01.276733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 135/266] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:01 2022] GET /identity/v3/role_assignments?user.id=f15db29e10cc4622a14b2a705f3bb3d4&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=de3989d133584bab8378c170cee57ac6 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:01.356071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bce5-6d21-4b8b-ad37-919a73624d3e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:01.357879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:01.398875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48acb2-b2f6-4d29-9e35-9ca76b045e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:01.399563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48acb2-b2f6-4d29-9e35-9ca76b045e2c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:01.399851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48acb2-b2f6-4d29-9e35-9ca76b045e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:01.400128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48acb2-b2f6-4d29-9e35-9ca76b045e2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:01.491918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48acb2-b2f6-4d29-9e35-9ca76b045e2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:01.493343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48acb2-b2f6-4d29-9e35-9ca76b045e2c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:01.621273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 132/267] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:01.627309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:01.740446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9196c3-6bc5-4c0a-8d64-5e4bb998e7cc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:01.772375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:01.779555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148e290-a1a5-4696-9e76-1c15a0655797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:01.780775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148e290-a1a5-4696-9e76-1c15a0655797 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:01.781276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148e290-a1a5-4696-9e76-1c15a0655797 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:01.781745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148e290-a1a5-4696-9e76-1c15a0655797 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:01.783375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148e290-a1a5-4696-9e76-1c15a0655797 None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:01.785043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148e290-a1a5-4696-9e76-1c15a0655797 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:01.787034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 136/268] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:01 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:01.793201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48acb2-b2f6-4d29-9e35-9ca76b045e2c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:01.795721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:01.901086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48acb2-b2f6-4d29-9e35-9ca76b045e2c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:01.941722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921fb2-b4ca-40a0-8abf-8caf917b8031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:01.943230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921fb2-b4ca-40a0-8abf-8caf917b8031 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:01.943763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921fb2-b4ca-40a0-8abf-8caf917b8031 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:01.944233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921fb2-b4ca-40a0-8abf-8caf917b8031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:01.945273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921fb2-b4ca-40a0-8abf-8caf917b8031 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=5c75dc25d4a74e258aebc6a53b585817, user.id=f15db29e10cc4622a14b2a705f3bb3d4) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:01.945826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921fb2-b4ca-40a0-8abf-8caf917b8031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:01.947503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921fb2-b4ca-40a0-8abf-8caf917b8031 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:01.954983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 133/269] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:01 2022] GET /identity/v3/role_assignments?user.id=f15db29e10cc4622a14b2a705f3bb3d4&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:01.977939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223533b5-83c7-4522-b07d-3b7007659325 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:01.978982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223533b5-83c7-4522-b07d-3b7007659325 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:01.979484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223533b5-83c7-4522-b07d-3b7007659325 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:01.981215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 137/270] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:01.987273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec221-87b0-4933-9ecc-90a1a06bb6e1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:01.987975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec221-87b0-4933-9ecc-90a1a06bb6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:01.988450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec221-87b0-4933-9ecc-90a1a06bb6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.014972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-64aec221-87b0-4933-9ecc-90a1a06bb6e1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:02.016560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-64aec221-87b0-4933-9ecc-90a1a06bb6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:02.101835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:02.116052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 134/271] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:02.164333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223533b5-83c7-4522-b07d-3b7007659325 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.226301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6664c-6213-4dd4-90f7-433b842424d1 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.227371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6664c-6213-4dd4-90f7-433b842424d1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.228121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6664c-6213-4dd4-90f7-433b842424d1 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.229930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 135/272] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:02.235513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171b9c-5701-4d89-825d-89ccc67c781f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.236189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171b9c-5701-4d89-825d-89ccc67c781f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.237019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171b9c-5701-4d89-825d-89ccc67c781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.259662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-87171b9c-5701-4d89-825d-89ccc67c781f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:02.260921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-87171b9c-5701-4d89-825d-89ccc67c781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:02.299426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223533b5-83c7-4522-b07d-3b7007659325 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:02.335398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ade5a-dba8-4d87-bcfc-505c342f05fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:02.336205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ade5a-dba8-4d87-bcfc-505c342f05fb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.336479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ade5a-dba8-4d87-bcfc-505c342f05fb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.336746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ade5a-dba8-4d87-bcfc-505c342f05fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.343051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 136/273] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:02.344851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f4c5b-f7a8-47cf-9aa3-d5ae8a82c05a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.345140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f4c5b-f7a8-47cf-9aa3-d5ae8a82c05a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.345415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f4c5b-f7a8-47cf-9aa3-d5ae8a82c05a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.346894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 137/274] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:02.352266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d73400-e8a0-4338-b668-86e9528352a2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.352498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d73400-e8a0-4338-b668-86e9528352a2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.352752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d73400-e8a0-4338-b668-86e9528352a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.359692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ade5a-dba8-4d87-bcfc-505c342f05fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-372ade5a-dba8-4d87-bcfc-505c342f05fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:02.369050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:02.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:02.370846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:02.371622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 138/275] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:02.371929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ade5a-dba8-4d87-bcfc-505c342f05fb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.373148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-26d73400-e8a0-4338-b668-86e9528352a2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:02.375439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-26d73400-e8a0-4338-b668-86e9528352a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:02.433766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:02.449175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 138/276] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:02.458678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d73400-e8a0-4338-b668-86e9528352a2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.478974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ade5a-dba8-4d87-bcfc-505c342f05fb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:02.514882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f33a-8c84-4441-a246-b1b1d56748ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:02.515821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f33a-8c84-4441-a246-b1b1d56748ed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.516166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f33a-8c84-4441-a246-b1b1d56748ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.516518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f33a-8c84-4441-a246-b1b1d56748ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.517703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4f33a-8c84-4441-a246-b1b1d56748ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:02.519195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4f33a-8c84-4441-a246-b1b1d56748ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:02.520842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 139/277] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:02.521641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f33a-8c84-4441-a246-b1b1d56748ed None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.522845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:02.575264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d73400-e8a0-4338-b668-86e9528352a2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:02.612337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:02.613365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.613885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.614349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.615801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:02.616373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:02.618091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:02.621059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f33a-8c84-4441-a246-b1b1d56748ed None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:02.627230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 139/278] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:02.628430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.651262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:02.661385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6513-a8a4-4468-9e96-e0a967189758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:02.662300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6513-a8a4-4468-9e96-e0a967189758 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.662584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6513-a8a4-4468-9e96-e0a967189758 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.662858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6513-a8a4-4468-9e96-e0a967189758 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.673348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a6513-a8a4-4468-9e96-e0a967189758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8f5a6513-a8a4-4468-9e96-e0a967189758 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:02.681468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:02.682538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:02.683336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:02.684622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6513-a8a4-4468-9e96-e0a967189758 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.744314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d5b87-03d9-42b9-8e76-0919b1a67be4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:02.761270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:02.778230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7561b-ead5-4fc0-984d-a0e6f71fc7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:02.778909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7561b-ead5-4fc0-984d-a0e6f71fc7be None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.779188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7561b-ead5-4fc0-984d-a0e6f71fc7be None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.779464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7561b-ead5-4fc0-984d-a0e6f71fc7be None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.780171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7561b-ead5-4fc0-984d-a0e6f71fc7be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:02.781631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7561b-ead5-4fc0-984d-a0e6f71fc7be None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:02.804250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 140/280] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:59:02 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:02.810052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7561b-ead5-4fc0-984d-a0e6f71fc7be None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.815201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6513-a8a4-4468-9e96-e0a967189758 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:02.853865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d0659-87c3-4a29-a64f-fbde6835aeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:02.854773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0659-87c3-4a29-a64f-fbde6835aeab None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.855056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0659-87c3-4a29-a64f-fbde6835aeab None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.855332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0659-87c3-4a29-a64f-fbde6835aeab None admin] PATH_INFO: `/v3/users/468a248719e240778e33d3581ef5c0ab` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.871706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d0659-87c3-4a29-a64f-fbde6835aeab None admin] RBAC: Authorizing `identity:get_user(user_id=468a248719e240778e33d3581ef5c0ab)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:02.873160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d0659-87c3-4a29-a64f-fbde6835aeab None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:02.879978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 141/281] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:02 2022] GET /identity/v3/users/468a248719e240778e33d3581ef5c0ab => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:02.881109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d0659-87c3-4a29-a64f-fbde6835aeab None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.920924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7561b-ead5-4fc0-984d-a0e6f71fc7be None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:02.932965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:02.959127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:02.959960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:02.960240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:02.960514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:02.961281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:02.961583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:02.963048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:02.972925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 141/282] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:02.978787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:02.997690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d0659-87c3-4a29-a64f-fbde6835aeab None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:03.022769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:03.042298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:03.042968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.043250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.043521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.044361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] RBAC: Adding query filter params (role.id=49ef71b3a9cd4f78998c8e7924bc1fac, user.id=468a248719e240778e33d3581ef5c0ab, scope.system=all) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:03.044670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:03.046185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:03.057836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 142/283] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 23 16:59:02 2022] GET /identity/v3/role_assignments?user.id=468a248719e240778e33d3581ef5c0ab&scope.system=all&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:03.123000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb65d3e-8c0a-4bd3-8ca0-a1ef112f1f87 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:03.163648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5d938-d588-4b7f-82ee-fc6b36ccc5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:03.164559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5d938-d588-4b7f-82ee-fc6b36ccc5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.164837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5d938-d588-4b7f-82ee-fc6b36ccc5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.165107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5d938-d588-4b7f-82ee-fc6b36ccc5f1 None admin] PATH_INFO: `/v3/users/7430c6e8eb6c4b57ba323be4eed51ded` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.166380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5d938-d588-4b7f-82ee-fc6b36ccc5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=7430c6e8eb6c4b57ba323be4eed51ded)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:03.167859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5d938-d588-4b7f-82ee-fc6b36ccc5f1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:03.169727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 142/284] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:02 2022] GET /identity/v3/users/7430c6e8eb6c4b57ba323be4eed51ded => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:03.175393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:03.207390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d583e-f916-403f-a108-3ca56234eb8c None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.207675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d583e-f916-403f-a108-3ca56234eb8c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.207955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d583e-f916-403f-a108-3ca56234eb8c None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.209785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 143/285] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:03.215999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f58e-5568-409c-acf1-8564d1eb6638 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.216800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f58e-5568-409c-acf1-8564d1eb6638 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.217089 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f58e-5568-409c-acf1-8564d1eb6638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.237370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-35b2f58e-5568-409c-acf1-8564d1eb6638 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:03.238714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-35b2f58e-5568-409c-acf1-8564d1eb6638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:03.297540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d968-a1df-4e5d-8947-d302b8a54236 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:03.308429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:03.328544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 144/286] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:03.349309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5139-05b8-43f6-94e1-1feeef173c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:03.350624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5139-05b8-43f6-94e1-1feeef173c1f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.351101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5139-05b8-43f6-94e1-1feeef173c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.351566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5139-05b8-43f6-94e1-1feeef173c1f None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.353195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2f58e-5568-409c-acf1-8564d1eb6638 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:03.364693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a5139-05b8-43f6-94e1-1feeef173c1f None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:03.366289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a5139-05b8-43f6-94e1-1feeef173c1f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:03.368089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 143/287] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:03 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:03.374338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5139-05b8-43f6-94e1-1feeef173c1f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:03.410590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:03.515438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2f58e-5568-409c-acf1-8564d1eb6638 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:03.577630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5139-05b8-43f6-94e1-1feeef173c1f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:03.592263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4d8cf-e831-4c0c-80d1-bccad3b0721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:03.593083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d8cf-e831-4c0c-80d1-bccad3b0721b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.593358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d8cf-e831-4c0c-80d1-bccad3b0721b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.593623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4d8cf-e831-4c0c-80d1-bccad3b0721b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.604414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4d8cf-e831-4c0c-80d1-bccad3b0721b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-8af4d8cf-e831-4c0c-80d1-bccad3b0721b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:03.612151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:03.613071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:03.613922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 145/288] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:03.620980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4d8cf-e831-4c0c-80d1-bccad3b0721b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:03.642363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54813522-8530-4df9-9a95-ef32b009b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:03.643249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54813522-8530-4df9-9a95-ef32b009b1eb None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.643525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54813522-8530-4df9-9a95-ef32b009b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.643795 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54813522-8530-4df9-9a95-ef32b009b1eb None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817/users/7430c6e8eb6c4b57ba323be4eed51ded/roles/2affecf7dda148d6a834671d7fa0ef8d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.646126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54813522-8530-4df9-9a95-ef32b009b1eb None admin] RBAC: Authorizing `identity:create_grant(project_id=5c75dc25d4a74e258aebc6a53b585817, user_id=7430c6e8eb6c4b57ba323be4eed51ded, role_id=2affecf7dda148d6a834671d7fa0ef8d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:03.647647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54813522-8530-4df9-9a95-ef32b009b1eb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:03.675678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 144/289] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:59:03 2022] PUT /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817/users/7430c6e8eb6c4b57ba323be4eed51ded/roles/2affecf7dda148d6a834671d7fa0ef8d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:03.733400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:03.740672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4d8cf-e831-4c0c-80d1-bccad3b0721b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:03.777599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:03.778313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.778591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.778864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.779618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:03.779921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:03.781306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:03.791509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 146/290] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:03.797322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54813522-8530-4df9-9a95-ef32b009b1eb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:03.855027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:03.929607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54813522-8530-4df9-9a95-ef32b009b1eb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:03.967333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba068542-08d5-4c49-b077-07630e2e6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:03.968217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068542-08d5-4c49-b077-07630e2e6b30 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:03.968495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068542-08d5-4c49-b077-07630e2e6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:03.968764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068542-08d5-4c49-b077-07630e2e6b30 None admin] PATH_INFO: `/v3/users/6e55a90f1a7d441c9009a95b82ce2600` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:03.970001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba068542-08d5-4c49-b077-07630e2e6b30 None admin] RBAC: Authorizing `identity:get_user(user_id=6e55a90f1a7d441c9009a95b82ce2600)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:03.971459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba068542-08d5-4c49-b077-07630e2e6b30 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:03.973451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 145/291] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:03 2022] GET /identity/v3/users/6e55a90f1a7d441c9009a95b82ce2600 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:03.978936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:04.096782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a973c-94be-490a-b1a0-efc6635acd45 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:04.136933 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e12cd-2f83-43a0-819c-07beb6514bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:04.137593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e12cd-2f83-43a0-819c-07beb6514bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:04.137913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e12cd-2f83-43a0-819c-07beb6514bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:04.138192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e12cd-2f83-43a0-819c-07beb6514bc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:04.172322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:04.226959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e12cd-2f83-43a0-819c-07beb6514bc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:04.228338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e12cd-2f83-43a0-819c-07beb6514bc4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:04.357676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 147/292] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:04.362892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba068542-08d5-4c49-b077-07630e2e6b30 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:04.484965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba068542-08d5-4c49-b077-07630e2e6b30 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:04.487626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:04.522586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296ae0f-477c-4104-8383-ab63f65a4e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:04.523826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296ae0f-477c-4104-8383-ab63f65a4e55 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:04.524295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296ae0f-477c-4104-8383-ab63f65a4e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:04.524777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296ae0f-477c-4104-8383-ab63f65a4e55 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:04.526199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296ae0f-477c-4104-8383-ab63f65a4e55 None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:04.527956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296ae0f-477c-4104-8383-ab63f65a4e55 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:04.530267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 146/293] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:04 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:04.535785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e12cd-2f83-43a0-819c-07beb6514bc4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:04.630459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:04.688131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e12cd-2f83-43a0-819c-07beb6514bc4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:04.739725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18702a34-8443-4b97-a722-399898bce7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:04.740378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18702a34-8443-4b97-a722-399898bce7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:04.740717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18702a34-8443-4b97-a722-399898bce7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:04.740998 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18702a34-8443-4b97-a722-399898bce7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:04.741843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18702a34-8443-4b97-a722-399898bce7b1 None admin] RBAC: Adding query filter params (role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=5c75dc25d4a74e258aebc6a53b585817, user.id=6e55a90f1a7d441c9009a95b82ce2600) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:04.742160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18702a34-8443-4b97-a722-399898bce7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:04.743613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18702a34-8443-4b97-a722-399898bce7b1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:04.754576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 148/294] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:04 2022] GET /identity/v3/role_assignments?user.id=6e55a90f1a7d441c9009a95b82ce2600&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:05.376146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fde15-33b6-4262-9d99-0d09c0d79199 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.376146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fde15-33b6-4262-9d99-0d09c0d79199 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.376146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fde15-33b6-4262-9d99-0d09c0d79199 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.377212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 147/295] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:05.383588 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d8a9-ff5e-44a7-b2f1-e61a19c6452e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.384414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d8a9-ff5e-44a7-b2f1-e61a19c6452e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.384879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d8a9-ff5e-44a7-b2f1-e61a19c6452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.405326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-ac94d8a9-ff5e-44a7-b2f1-e61a19c6452e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:05.406867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ac94d8a9-ff5e-44a7-b2f1-e61a19c6452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:05.474537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ceaa3-bfa9-4b47-8f8f-a6364e7619ad None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.474916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ceaa3-bfa9-4b47-8f8f-a6364e7619ad None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.475099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ceaa3-bfa9-4b47-8f8f-a6364e7619ad None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.476760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 148/296] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:05.481878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53b42-8b32-4bdd-a9e4-74a8e4a25557 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.482168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53b42-8b32-4bdd-a9e4-74a8e4a25557 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.482444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53b42-8b32-4bdd-a9e4-74a8e4a25557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.483172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 149/297] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:05.501428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-75a53b42-8b32-4bdd-a9e4-74a8e4a25557 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:05.502645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-75a53b42-8b32-4bdd-a9e4-74a8e4a25557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:05.507070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d8a9-ff5e-44a7-b2f1-e61a19c6452e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:05.557547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:05.588399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 149/298] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:05.596066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45739ef-0762-4097-b85c-1528fb270e77 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.596355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45739ef-0762-4097-b85c-1528fb270e77 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.596633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45739ef-0762-4097-b85c-1528fb270e77 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.601751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 150/299] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:05.603016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7921c88-3c30-48ae-8c77-d7fea63a77e3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.603201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7921c88-3c30-48ae-8c77-d7fea63a77e3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.603479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7921c88-3c30-48ae-8c77-d7fea63a77e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.616760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d8a9-ff5e-44a7-b2f1-e61a19c6452e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:05.620242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c7921c88-3c30-48ae-8c77-d7fea63a77e3 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:05.621505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c7921c88-3c30-48ae-8c77-d7fea63a77e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:05.651770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5c0a-1ba7-48d9-9295-8339d20e3414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:05.652514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5c0a-1ba7-48d9-9295-8339d20e3414 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.652789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5c0a-1ba7-48d9-9295-8339d20e3414 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.653063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5c0a-1ba7-48d9-9295-8339d20e3414 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.663858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd5c0a-1ba7-48d9-9295-8339d20e3414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-48bd5c0a-1ba7-48d9-9295-8339d20e3414 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:05.671662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:05.672577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:05.673391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 150/300] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:05.674114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5c0a-1ba7-48d9-9295-8339d20e3414 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:05.705602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 151/301] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:05.706325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7921c88-3c30-48ae-8c77-d7fea63a77e3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:05.741362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:05.788786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5c0a-1ba7-48d9-9295-8339d20e3414 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:05.799028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:05.820311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7921c88-3c30-48ae-8c77-d7fea63a77e3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:05.825481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eadf19-a315-4fa8-9584-aefa2037e456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:05.826325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eadf19-a315-4fa8-9584-aefa2037e456 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.826606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eadf19-a315-4fa8-9584-aefa2037e456 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.826875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eadf19-a315-4fa8-9584-aefa2037e456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.837976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eadf19-a315-4fa8-9584-aefa2037e456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-61eadf19-a315-4fa8-9584-aefa2037e456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:05.845763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:05.846684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:05.847498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 151/302] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:05.848155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eadf19-a315-4fa8-9584-aefa2037e456 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:05.859085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:05.859755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.860040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.860318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:05.861073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:05.861379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:05.862790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:05.875993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 152/303] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:05.875993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:05.960672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eadf19-a315-4fa8-9584-aefa2037e456 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:05.975211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:05.983538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56d1df-7504-4c17-9f13-9fb02c72875c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:05.997089 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3750816-b5a8-4f5b-9c8d-2bb2ef573cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:05.998352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3750816-b5a8-4f5b-9c8d-2bb2ef573cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:05.999132 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3750816-b5a8-4f5b-9c8d-2bb2ef573cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:05.999841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3750816-b5a8-4f5b-9c8d-2bb2ef573cd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.001372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3750816-b5a8-4f5b-9c8d-2bb2ef573cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:06.003320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3750816-b5a8-4f5b-9c8d-2bb2ef573cd4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:06.006148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 152/304] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:06.007149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3750816-b5a8-4f5b-9c8d-2bb2ef573cd4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:06.018869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:06.019550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.019830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.020102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.020850 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:06.021159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:06.022612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:06.035628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 153/305] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:06.035628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:06.056487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:06.119226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3750816-b5a8-4f5b-9c8d-2bb2ef573cd4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:06.143777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a6045-20d1-4d79-8e56-6bb104636722 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:06.154593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65219f62-fc5e-4f76-8b13-dfe85c9f1829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:06.155489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219f62-fc5e-4f76-8b13-dfe85c9f1829 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.155846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219f62-fc5e-4f76-8b13-dfe85c9f1829 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.156032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65219f62-fc5e-4f76-8b13-dfe85c9f1829 None admin] PATH_INFO: `/v3/users/d0ea88ebdb724c52bf9e3798188de597` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.170263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65219f62-fc5e-4f76-8b13-dfe85c9f1829 None admin] RBAC: Authorizing `identity:get_user(user_id=d0ea88ebdb724c52bf9e3798188de597)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:06.171858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65219f62-fc5e-4f76-8b13-dfe85c9f1829 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:06.178170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 153/306] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:06 2022] GET /identity/v3/users/d0ea88ebdb724c52bf9e3798188de597 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:06.178170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65219f62-fc5e-4f76-8b13-dfe85c9f1829 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:06.184370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c9c24-2058-44f1-999e-311e043d59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:06.185160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c9c24-2058-44f1-999e-311e043d59be None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.185508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c9c24-2058-44f1-999e-311e043d59be None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.185878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c9c24-2058-44f1-999e-311e043d59be None admin] PATH_INFO: `/v3/groups` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.186644 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c9c24-2058-44f1-999e-311e043d59be None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:06.188163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c9c24-2058-44f1-999e-311e043d59be None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:06.206742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 154/307] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Jun 23 16:59:06 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:06.208537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c9c24-2058-44f1-999e-311e043d59be None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:06.242923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:06.295186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:06.303024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65219f62-fc5e-4f76-8b13-dfe85c9f1829 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:06.337059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c9c24-2058-44f1-999e-311e043d59be None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:06.342019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33567a0-a35a-4c86-a18c-0a790da8ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:06.342917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33567a0-a35a-4c86-a18c-0a790da8ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.343194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33567a0-a35a-4c86-a18c-0a790da8ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.343462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33567a0-a35a-4c86-a18c-0a790da8ecc9 None admin] PATH_INFO: `/v3/users/468a248719e240778e33d3581ef5c0ab` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.344682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33567a0-a35a-4c86-a18c-0a790da8ecc9 None admin] RBAC: Authorizing `identity:get_user(user_id=468a248719e240778e33d3581ef5c0ab)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:06.346217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33567a0-a35a-4c86-a18c-0a790da8ecc9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:06.347960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 154/308] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:06 2022] GET /identity/v3/users/468a248719e240778e33d3581ef5c0ab => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:06.349194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7991c-d9d3-4c1f-a53f-9e095dae67a3 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.349550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7991c-d9d3-4c1f-a53f-9e095dae67a3 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.349956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7991c-d9d3-4c1f-a53f-9e095dae67a3 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.351434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 155/309] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:06.355794 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7991c-d9d3-4c1f-a53f-9e095dae67a3 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:06.390056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c0aa2-27ee-48a1-8cd9-e8706ad951ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:06.390792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0aa2-27ee-48a1-8cd9-e8706ad951ee None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.391078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0aa2-27ee-48a1-8cd9-e8706ad951ee None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.391550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c0aa2-27ee-48a1-8cd9-e8706ad951ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.392181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c0aa2-27ee-48a1-8cd9-e8706ad951ee None admin] RBAC: Adding query filter params (role.id=2affecf7dda148d6a834671d7fa0ef8d, user.id=d0ea88ebdb724c52bf9e3798188de597, scope.system=all) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:06.392547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c0aa2-27ee-48a1-8cd9-e8706ad951ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:06.394029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c0aa2-27ee-48a1-8cd9-e8706ad951ee None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:06.399387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 155/310] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 23 16:59:06 2022] GET /identity/v3/role_assignments?user.id=d0ea88ebdb724c52bf9e3798188de597&scope.system=all&role.id=2affecf7dda148d6a834671d7fa0ef8d => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:06.400610 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c591ce-3acd-4499-b463-ec722fcd90c3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.400890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c591ce-3acd-4499-b463-ec722fcd90c3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.401149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c591ce-3acd-4499-b463-ec722fcd90c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.420381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-50c591ce-3acd-4499-b463-ec722fcd90c3 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:06.421614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-50c591ce-3acd-4499-b463-ec722fcd90c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:06.492481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7991c-d9d3-4c1f-a53f-9e095dae67a3 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:06.516035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 156/311] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:06.532335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f9f89-c4b0-42d0-a990-9912d88c6d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:06.533601 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f9f89-c4b0-42d0-a990-9912d88c6d42 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.534110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f9f89-c4b0-42d0-a990-9912d88c6d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.534620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f9f89-c4b0-42d0-a990-9912d88c6d42 None admin] PATH_INFO: `/v3/system/users/468a248719e240778e33d3581ef5c0ab/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.536475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f9f89-c4b0-42d0-a990-9912d88c6d42 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=468a248719e240778e33d3581ef5c0ab, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:06.538935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f9f89-c4b0-42d0-a990-9912d88c6d42 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:06.541285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c591ce-3acd-4499-b463-ec722fcd90c3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:06.554745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 156/312] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Jun 23 16:59:06 2022] PUT /identity/v3/system/users/468a248719e240778e33d3581ef5c0ab/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:59:06.555502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:06.670131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c591ce-3acd-4499-b463-ec722fcd90c3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:06.710557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ea415-4f7f-45fa-8311-1576fdb02173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:06.711398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ea415-4f7f-45fa-8311-1576fdb02173 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.711689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ea415-4f7f-45fa-8311-1576fdb02173 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.711968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ea415-4f7f-45fa-8311-1576fdb02173 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.725158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ea415-4f7f-45fa-8311-1576fdb02173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4f0ea415-4f7f-45fa-8311-1576fdb02173 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:06.733613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:06.734552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:06.735370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 157/313] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:06.742105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f9f89-c4b0-42d0-a990-9912d88c6d42 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:06.775266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:06.847985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f9f89-c4b0-42d0-a990-9912d88c6d42 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:06.882179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:06.882855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:06.883131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:06.883406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:06.884152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:06.884452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:06.885848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:06.894709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 157/314] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:06.900516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ea415-4f7f-45fa-8311-1576fdb02173 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:06.974815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:07.007723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ea415-4f7f-45fa-8311-1576fdb02173 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:07.043480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50407f94-44ad-4ac6-91d4-84f79a072dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:07.044432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50407f94-44ad-4ac6-91d4-84f79a072dcc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:07.044714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50407f94-44ad-4ac6-91d4-84f79a072dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:07.044990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50407f94-44ad-4ac6-91d4-84f79a072dcc None admin] PATH_INFO: `/v3/users/7430c6e8eb6c4b57ba323be4eed51ded` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:07.046276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50407f94-44ad-4ac6-91d4-84f79a072dcc None admin] RBAC: Authorizing `identity:get_user(user_id=7430c6e8eb6c4b57ba323be4eed51ded)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:07.047735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50407f94-44ad-4ac6-91d4-84f79a072dcc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:07.049447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 158/315] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:06 2022] GET /identity/v3/users/7430c6e8eb6c4b57ba323be4eed51ded => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:07.055170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:07.147408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:07.156973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006a309-f170-4e9a-b23a-d699f8f68bb3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:07.191441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732731b-55ef-4512-ac7c-328ae8480af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:07.192089 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732731b-55ef-4512-ac7c-328ae8480af8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:07.192366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732731b-55ef-4512-ac7c-328ae8480af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:07.192633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732731b-55ef-4512-ac7c-328ae8480af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:07.261254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732731b-55ef-4512-ac7c-328ae8480af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:07.265978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732731b-55ef-4512-ac7c-328ae8480af8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:07.357499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:07.368173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 158/316] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:07.373901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50407f94-44ad-4ac6-91d4-84f79a072dcc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:07.482720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50407f94-44ad-4ac6-91d4-84f79a072dcc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:07.517712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e73ec-62fb-4cf7-90cf-0ae3ad0b4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:07.518614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e73ec-62fb-4cf7-90cf-0ae3ad0b4d22 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:07.518890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e73ec-62fb-4cf7-90cf-0ae3ad0b4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:07.519165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e73ec-62fb-4cf7-90cf-0ae3ad0b4d22 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:07.520341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e73ec-62fb-4cf7-90cf-0ae3ad0b4d22 None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:07.521859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e73ec-62fb-4cf7-90cf-0ae3ad0b4d22 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:07.523936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 159/317] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:07 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:07.530912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732731b-55ef-4512-ac7c-328ae8480af8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:07.632982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732731b-55ef-4512-ac7c-328ae8480af8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:07.670459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7fd5c-a5a4-4472-96e1-05fed46402e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:07.671475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7fd5c-a5a4-4472-96e1-05fed46402e2 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:07.671974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7fd5c-a5a4-4472-96e1-05fed46402e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:07.672439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7fd5c-a5a4-4472-96e1-05fed46402e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:07.673463 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7fd5c-a5a4-4472-96e1-05fed46402e2 None admin] RBAC: Adding query filter params (role.id=2affecf7dda148d6a834671d7fa0ef8d, scope.project.id=5c75dc25d4a74e258aebc6a53b585817, user.id=7430c6e8eb6c4b57ba323be4eed51ded) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:07.673988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7fd5c-a5a4-4472-96e1-05fed46402e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:07.675659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7fd5c-a5a4-4472-96e1-05fed46402e2 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:07.693227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 159/318] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:07 2022] GET /identity/v3/role_assignments?user.id=7430c6e8eb6c4b57ba323be4eed51ded&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=2affecf7dda148d6a834671d7fa0ef8d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:08.323648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933258a-0cf5-4931-b6d9-957539cf2732 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.324053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933258a-0cf5-4931-b6d9-957539cf2732 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.324224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933258a-0cf5-4931-b6d9-957539cf2732 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.325756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 160/319] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:08.331304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929d96-20f8-4c0a-9f5a-2595edf57376 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.331595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929d96-20f8-4c0a-9f5a-2595edf57376 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.331864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929d96-20f8-4c0a-9f5a-2595edf57376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.349140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4f929d96-20f8-4c0a-9f5a-2595edf57376 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:08.350442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4f929d96-20f8-4c0a-9f5a-2595edf57376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:08.404992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:08.423947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 160/320] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:08.448034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933258a-0cf5-4931-b6d9-957539cf2732 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:08.458385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:08.554892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933258a-0cf5-4931-b6d9-957539cf2732 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:08.562831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409019-b9d4-45ab-ba1c-8e2aa067e387 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.563339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409019-b9d4-45ab-ba1c-8e2aa067e387 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.563578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409019-b9d4-45ab-ba1c-8e2aa067e387 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.565451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 161/321] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:08.570909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586b5e-77bd-40ad-b552-c3e8c7cc1d0e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.571425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586b5e-77bd-40ad-b552-c3e8c7cc1d0e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.571709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586b5e-77bd-40ad-b552-c3e8c7cc1d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.589833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9f586b5e-77bd-40ad-b552-c3e8c7cc1d0e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:08.591007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9f586b5e-77bd-40ad-b552-c3e8c7cc1d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:08.594848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85044abd-0df5-423b-a125-b948b726db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:08.595888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044abd-0df5-423b-a125-b948b726db32 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.596400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044abd-0df5-423b-a125-b948b726db32 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.596809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044abd-0df5-423b-a125-b948b726db32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.598157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85044abd-0df5-423b-a125-b948b726db32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:08.600242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85044abd-0df5-423b-a125-b948b726db32 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:08.602791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 161/322] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:08.608213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85044abd-0df5-423b-a125-b948b726db32 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:08.661726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 162/323] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:08.663102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e5fd-e5a8-46c3-9efc-26f6db4acc6f None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.663386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e5fd-e5a8-46c3-9efc-26f6db4acc6f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.663660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89e5fd-e5a8-46c3-9efc-26f6db4acc6f None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.665532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 163/324] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:08.671543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035bac-5057-4170-aed9-acef543306be None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.672234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035bac-5057-4170-aed9-acef543306be None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.672693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035bac-5057-4170-aed9-acef543306be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.685496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:08.689780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-43035bac-5057-4170-aed9-acef543306be None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:08.690986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-43035bac-5057-4170-aed9-acef543306be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:08.712189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85044abd-0df5-423b-a125-b948b726db32 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:08.744389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e5176-3171-4471-9f0c-245c4e43945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:08.745018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e5176-3171-4471-9f0c-245c4e43945c None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.745292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e5176-3171-4471-9f0c-245c4e43945c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.745561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e5176-3171-4471-9f0c-245c4e43945c None admin] PATH_INFO: `/v3/groups` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.746276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e5176-3171-4471-9f0c-245c4e43945c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:08.747714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e5176-3171-4471-9f0c-245c4e43945c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:08.758864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 164/325] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:08.760114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43035bac-5057-4170-aed9-acef543306be None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:08.772022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 162/326] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Jun 23 16:59:08 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:59:08.790580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e5176-3171-4471-9f0c-245c4e43945c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:08.814400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:08.877648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43035bac-5057-4170-aed9-acef543306be None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:08.906311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e5176-3171-4471-9f0c-245c4e43945c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:08.918167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757bc6-983e-4a07-a993-2a7283fc1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:08.918990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757bc6-983e-4a07-a993-2a7283fc1236 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.919270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757bc6-983e-4a07-a993-2a7283fc1236 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.919545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757bc6-983e-4a07-a993-2a7283fc1236 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.931296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b757bc6-983e-4a07-a993-2a7283fc1236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-0b757bc6-983e-4a07-a993-2a7283fc1236 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:08.938962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:08.940001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:08.940904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 165/327] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:08.946393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e12b90-57f2-46de-a0d6-0429df8b6d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:08.946599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757bc6-983e-4a07-a993-2a7283fc1236 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:08.947217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e12b90-57f2-46de-a0d6-0429df8b6d39 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:08.947501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e12b90-57f2-46de-a0d6-0429df8b6d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:08.947783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e12b90-57f2-46de-a0d6-0429df8b6d39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:08.949811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:08.963738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e12b90-57f2-46de-a0d6-0429df8b6d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d2e12b90-57f2-46de-a0d6-0429df8b6d39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:08.971702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:08.972594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:08.973420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 163/328] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:08.979127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e12b90-57f2-46de-a0d6-0429df8b6d39 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:09.073513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757bc6-983e-4a07-a993-2a7283fc1236 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:09.076398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:09.108769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e12b90-57f2-46de-a0d6-0429df8b6d39 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:09.117521 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:09.118611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:09.119025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:09.119477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:09.120421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:09.120850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:09.122417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:09.132446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 166/329] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:09.139168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:09.146671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:09.147352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:09.147636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:09.147909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:09.148923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:09.149235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:09.150707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:09.160257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 164/330] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:09.167072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:09.239249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:09.268504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d1df3-1661-4fa3-a120-7b0b2203d145 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:09.294558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfd34c-4528-4d32-985f-73ff12a66059 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:09.315281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5be9e-0024-4659-aa66-0e11cc0a3d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:09.315281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5be9e-0024-4659-aa66-0e11cc0a3d4d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:09.315281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5be9e-0024-4659-aa66-0e11cc0a3d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:09.315626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5be9e-0024-4659-aa66-0e11cc0a3d4d None admin] PATH_INFO: `/v3/users/d0ea88ebdb724c52bf9e3798188de597` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:09.318456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5be9e-0024-4659-aa66-0e11cc0a3d4d None admin] RBAC: Authorizing `identity:get_user(user_id=d0ea88ebdb724c52bf9e3798188de597)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:09.319975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5be9e-0024-4659-aa66-0e11cc0a3d4d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:09.322916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 167/331] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:09 2022] GET /identity/v3/users/d0ea88ebdb724c52bf9e3798188de597 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:09.331654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5be9e-0024-4659-aa66-0e11cc0a3d4d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:09.353510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685947a-d452-4a63-bb01-ce69d8ed4369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:09.357258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685947a-d452-4a63-bb01-ce69d8ed4369 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:09.357258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685947a-d452-4a63-bb01-ce69d8ed4369 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:09.357258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685947a-d452-4a63-bb01-ce69d8ed4369 None admin] PATH_INFO: `/v3/users/468a248719e240778e33d3581ef5c0ab` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:09.357898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685947a-d452-4a63-bb01-ce69d8ed4369 None admin] RBAC: Authorizing `identity:get_user(user_id=468a248719e240778e33d3581ef5c0ab)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:09.359704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685947a-d452-4a63-bb01-ce69d8ed4369 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:09.365828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 165/332] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:09 2022] GET /identity/v3/users/468a248719e240778e33d3581ef5c0ab => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:09.368333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685947a-d452-4a63-bb01-ce69d8ed4369 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:09.384453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:09.459307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5be9e-0024-4659-aa66-0e11cc0a3d4d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:09.477520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685947a-d452-4a63-bb01-ce69d8ed4369 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:09.496022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0b84b-9a05-4fd3-a80a-dc21dc6bfecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:09.496887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b84b-9a05-4fd3-a80a-dc21dc6bfecf None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:09.497171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b84b-9a05-4fd3-a80a-dc21dc6bfecf None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:09.497447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b84b-9a05-4fd3-a80a-dc21dc6bfecf None admin] PATH_INFO: `/v3/system/users/d0ea88ebdb724c52bf9e3798188de597/roles/2affecf7dda148d6a834671d7fa0ef8d` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:09.499022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0b84b-9a05-4fd3-a80a-dc21dc6bfecf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d0ea88ebdb724c52bf9e3798188de597, role_id=2affecf7dda148d6a834671d7fa0ef8d)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:09.500434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0b84b-9a05-4fd3-a80a-dc21dc6bfecf None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:09.504224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:09.512615 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 168/333] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Jun 23 16:59:09 2022] PUT /identity/v3/system/users/d0ea88ebdb724c52bf9e3798188de597/roles/2affecf7dda148d6a834671d7fa0ef8d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:09.523454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467a795-c776-49f5-8b96-b87e6bd62759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:09.524444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467a795-c776-49f5-8b96-b87e6bd62759 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:09.524915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467a795-c776-49f5-8b96-b87e6bd62759 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:09.525380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467a795-c776-49f5-8b96-b87e6bd62759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:09.526464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467a795-c776-49f5-8b96-b87e6bd62759 None admin] RBAC: Adding query filter params (role.id=49ef71b3a9cd4f78998c8e7924bc1fac, user.id=468a248719e240778e33d3581ef5c0ab, scope.system=all) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:09.526922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467a795-c776-49f5-8b96-b87e6bd62759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:09.528571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467a795-c776-49f5-8b96-b87e6bd62759 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:09.544411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 166/334] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 23 16:59:09 2022] GET /identity/v3/role_assignments?user.id=468a248719e240778e33d3581ef5c0ab&scope.system=all&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:11.154736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7617a-50eb-4aca-9265-a002bf2fd468 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:11.155655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7617a-50eb-4aca-9265-a002bf2fd468 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:11.156072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7617a-50eb-4aca-9265-a002bf2fd468 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:11.157849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 169/335] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:11.163706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab329-1afc-40ca-94ec-305da39c6a14 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:11.164502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab329-1afc-40ca-94ec-305da39c6a14 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:11.164918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab329-1afc-40ca-94ec-305da39c6a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:11.185090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4c5ab329-1afc-40ca-94ec-305da39c6a14 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:11.186548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4c5ab329-1afc-40ca-94ec-305da39c6a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:11.271504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 167/336] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:11.314330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7617a-50eb-4aca-9265-a002bf2fd468 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:11.432820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:11.442176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7617a-50eb-4aca-9265-a002bf2fd468 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:11.489496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90240390-64dd-4631-a060-f42ed48a8dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:11.490713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90240390-64dd-4631-a060-f42ed48a8dbc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:11.491249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90240390-64dd-4631-a060-f42ed48a8dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:11.491668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90240390-64dd-4631-a060-f42ed48a8dbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:11.503608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90240390-64dd-4631-a060-f42ed48a8dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-90240390-64dd-4631-a060-f42ed48a8dbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:11.512350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:11.513528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:11.514571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:11.516715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 170/337] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:11.522982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ab329-1afc-40ca-94ec-305da39c6a14 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:11.632708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ab329-1afc-40ca-94ec-305da39c6a14 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:11.647068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:11.674354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f57bf-c1a7-4f74-8638-b20d0750e16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:11.675038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f57bf-c1a7-4f74-8638-b20d0750e16a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:11.675322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f57bf-c1a7-4f74-8638-b20d0750e16a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:11.675596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f57bf-c1a7-4f74-8638-b20d0750e16a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:11.676359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f57bf-c1a7-4f74-8638-b20d0750e16a None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:11.676667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f57bf-c1a7-4f74-8638-b20d0750e16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:11.678167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f57bf-c1a7-4f74-8638-b20d0750e16a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:11.697699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 168/338] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:11.703935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90240390-64dd-4631-a060-f42ed48a8dbc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:11.873271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90240390-64dd-4631-a060-f42ed48a8dbc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:11.923543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd1aa6-2f4c-466f-9daa-42f66fd76583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:11.924198 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1aa6-2f4c-466f-9daa-42f66fd76583 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:11.924476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1aa6-2f4c-466f-9daa-42f66fd76583 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:11.924750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1aa6-2f4c-466f-9daa-42f66fd76583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:11.959040 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:11.982931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c73cc0-50e1-4180-9b03-47d38e55a14b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:11.983246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c73cc0-50e1-4180-9b03-47d38e55a14b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:11.983492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c73cc0-50e1-4180-9b03-47d38e55a14b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:11.985142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 169/339] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:11.993110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75156b6-6ccc-4319-955b-37b9c7729c92 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:11.993379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75156b6-6ccc-4319-955b-37b9c7729c92 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:11.993658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75156b6-6ccc-4319-955b-37b9c7729c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.012629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd1aa6-2f4c-466f-9daa-42f66fd76583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:12.014140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd1aa6-2f4c-466f-9daa-42f66fd76583 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:12.040425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b75156b6-6ccc-4319-955b-37b9c7729c92 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:12.041647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b75156b6-6ccc-4319-955b-37b9c7729c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:12.208939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 170/340] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:12.233653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 171/341] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:12.239580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75156b6-6ccc-4319-955b-37b9c7729c92 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:12.251932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd1aa6-2f4c-466f-9daa-42f66fd76583 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:12.389674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:12.432361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75156b6-6ccc-4319-955b-37b9c7729c92 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:12.446200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:12.495548 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd1aa6-2f4c-466f-9daa-42f66fd76583 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:12.514396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829081a-718a-4629-a15b-05e13dbb9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:12.515291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829081a-718a-4629-a15b-05e13dbb9d93 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:12.515570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829081a-718a-4629-a15b-05e13dbb9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:12.515850 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829081a-718a-4629-a15b-05e13dbb9d93 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.518516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829081a-718a-4629-a15b-05e13dbb9d93 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:12.519975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829081a-718a-4629-a15b-05e13dbb9d93 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:12.522390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 171/342] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:12 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:12.524695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac903c23-6840-4281-8a5a-0f0dede840ce None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:12.524981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac903c23-6840-4281-8a5a-0f0dede840ce None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:12.525263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac903c23-6840-4281-8a5a-0f0dede840ce None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.529782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 172/343] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:12.530533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac903c23-6840-4281-8a5a-0f0dede840ce None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:12.565202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a355905-bb56-456a-9285-d356028cef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:12.566052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355905-bb56-456a-9285-d356028cef16 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:12.566337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355905-bb56-456a-9285-d356028cef16 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:12.566611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355905-bb56-456a-9285-d356028cef16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.592534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a355905-bb56-456a-9285-d356028cef16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-0a355905-bb56-456a-9285-d356028cef16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:12.601059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:12.602066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:12.602882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:12.604497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 172/344] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:12.609733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a543a-8b81-4e89-ad11-8eb9e88d496e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:12.609733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a543a-8b81-4e89-ad11-8eb9e88d496e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:12.609733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a543a-8b81-4e89-ad11-8eb9e88d496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.628785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b53a543a-8b81-4e89-ad11-8eb9e88d496e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:12.630558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b53a543a-8b81-4e89-ad11-8eb9e88d496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:12.712493 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac903c23-6840-4281-8a5a-0f0dede840ce None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:12.734117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 173/345] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:12.736034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496da3-124b-429e-a4ed-bc13b00c499c None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:12.736471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496da3-124b-429e-a4ed-bc13b00c499c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:12.736993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496da3-124b-429e-a4ed-bc13b00c499c None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.738893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 174/346] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:12.739560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75496da3-124b-429e-a4ed-bc13b00c499c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:12.773473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb2a0f-5638-4f24-b173-763027838873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:12.774944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2a0f-5638-4f24-b173-763027838873 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:12.775242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2a0f-5638-4f24-b173-763027838873 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:12.775519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2a0f-5638-4f24-b173-763027838873 None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.782871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2a0f-5638-4f24-b173-763027838873 None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:12.784516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb2a0f-5638-4f24-b173-763027838873 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:12.787268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 173/347] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:12 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:12.788727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8cab-b035-4c96-b43c-2a9d0c27adc6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:12.789013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8cab-b035-4c96-b43c-2a9d0c27adc6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:12.789288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8cab-b035-4c96-b43c-2a9d0c27adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.819293 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1d7e8cab-b035-4c96-b43c-2a9d0c27adc6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:12.820534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1d7e8cab-b035-4c96-b43c-2a9d0c27adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:12.825127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:12.861557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:12.888933 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75496da3-124b-429e-a4ed-bc13b00c499c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:12.906395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 174/348] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:12.907321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e8cab-b035-4c96-b43c-2a9d0c27adc6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:12.935720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:12.937038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:12.937945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:12.938663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:12.939845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:12.940339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:12.942604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:12.954595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 175/349] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:12.956186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:13.026881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e8cab-b035-4c96-b43c-2a9d0c27adc6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:13.072013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e09ad-9b05-4733-b4e5-d1c2a6b0c99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:13.072848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e09ad-9b05-4733-b4e5-d1c2a6b0c99f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.073129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e09ad-9b05-4733-b4e5-d1c2a6b0c99f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.073399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e09ad-9b05-4733-b4e5-d1c2a6b0c99f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.085433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed959ee-4476-40ee-aa97-fc6be0c2a758 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:13.086945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e09ad-9b05-4733-b4e5-d1c2a6b0c99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-304e09ad-9b05-4733-b4e5-d1c2a6b0c99f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:13.096477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:13.097552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:13.098499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:13.099200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:13.099309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 175/350] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:13.100752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a43aa0-3c23-43f3-aeb1-5529b963913a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.101043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a43aa0-3c23-43f3-aeb1-5529b963913a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.101443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a43aa0-3c23-43f3-aeb1-5529b963913a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.107752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 176/351] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:13.107752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a43aa0-3c23-43f3-aeb1-5529b963913a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:13.138431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:13.139446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:13.140120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.140474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.140741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.141497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] RBAC: Adding query filter params (group.id=3ce7be0359614483b555ac166c9d3290, role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=a54cac18fe3448119899dcb53a77d938) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:13.141834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:13.145625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:13.154335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 176/352] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:12 2022] GET /identity/v3/role_assignments?group.id=3ce7be0359614483b555ac166c9d3290&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:13.155574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:13.252482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a43aa0-3c23-43f3-aeb1-5529b963913a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:13.295498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815ef15-c017-4ac5-92a8-76a6ab41bbbe None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:13.306487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa74e1-47e9-4561-8b9c-652e876e0d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:13.307543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa74e1-47e9-4561-8b9c-652e876e0d7a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.307931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa74e1-47e9-4561-8b9c-652e876e0d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.308298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa74e1-47e9-4561-8b9c-652e876e0d7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.327909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa74e1-47e9-4561-8b9c-652e876e0d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-55aa74e1-47e9-4561-8b9c-652e876e0d7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:13.336605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:13.337734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:13.338576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:13.340688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 177/353] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:59:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:13.345230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195932c-1557-4ef7-94e7-d8d12bd2ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:13.345811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98df21e-0201-4f16-a3ae-c9e36a3cdcb3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.346215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98df21e-0201-4f16-a3ae-c9e36a3cdcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.346424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195932c-1557-4ef7-94e7-d8d12bd2ee7f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.346673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98df21e-0201-4f16-a3ae-c9e36a3cdcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.346999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195932c-1557-4ef7-94e7-d8d12bd2ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.347423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195932c-1557-4ef7-94e7-d8d12bd2ee7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.366170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d98df21e-0201-4f16-a3ae-c9e36a3cdcb3 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:13.367530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d98df21e-0201-4f16-a3ae-c9e36a3cdcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:13.405624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:13.438572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195932c-1557-4ef7-94e7-d8d12bd2ee7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:13.440311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195932c-1557-4ef7-94e7-d8d12bd2ee7f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:13.454449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 178/354] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:13.455564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98df21e-0201-4f16-a3ae-c9e36a3cdcb3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:13.477703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:13.580072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 177/355] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:13.580927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195932c-1557-4ef7-94e7-d8d12bd2ee7f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:13.587012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98df21e-0201-4f16-a3ae-c9e36a3cdcb3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:13.635360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d6138-7d06-486a-8cf1-1ebdf19603e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:13.635360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d6138-7d06-486a-8cf1-1ebdf19603e8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.635666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d6138-7d06-486a-8cf1-1ebdf19603e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.635923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d6138-7d06-486a-8cf1-1ebdf19603e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.636598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d6138-7d06-486a-8cf1-1ebdf19603e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:13.636903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d6138-7d06-486a-8cf1-1ebdf19603e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:13.639411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d6138-7d06-486a-8cf1-1ebdf19603e8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:13.650824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 179/356] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:13.651328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77e61-088b-4e2b-8c08-065da24ff745 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.651621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77e61-088b-4e2b-8c08-065da24ff745 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.651894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77e61-088b-4e2b-8c08-065da24ff745 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.653160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 180/357] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:13.654829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77e61-088b-4e2b-8c08-065da24ff745 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:13.672061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:13.709831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195932c-1557-4ef7-94e7-d8d12bd2ee7f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:13.756042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:13.757177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.757460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.757737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.758541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:13.758855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:13.760271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:13.769835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 178/358] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:13.770503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:13.775650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:13.805109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77e61-088b-4e2b-8c08-065da24ff745 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:13.853078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ad09-9877-4832-a9eb-f9ce9745aff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:13.853876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ad09-9877-4832-a9eb-f9ce9745aff5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.854162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ad09-9877-4832-a9eb-f9ce9745aff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.854435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ad09-9877-4832-a9eb-f9ce9745aff5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.870390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ad09-9877-4832-a9eb-f9ce9745aff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-20d8ad09-9877-4832-a9eb-f9ce9745aff5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:13.879070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:13.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 16:59:13.880845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:13.883007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 181/359] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:13.884023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ad09-9877-4832-a9eb-f9ce9745aff5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:13.898135 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d428-3b24-469c-9dd7-d7367caeb8e0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:13.939915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603e90b-9866-44dc-9f11-ad3b9ecd9ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:13.940795 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e90b-9866-44dc-9f11-ad3b9ecd9ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.941074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e90b-9866-44dc-9f11-ad3b9ecd9ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.941346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e90b-9866-44dc-9f11-ad3b9ecd9ff4 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.942568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603e90b-9866-44dc-9f11-ad3b9ecd9ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:13.944619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603e90b-9866-44dc-9f11-ad3b9ecd9ff4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:13.949874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 179/360] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:13 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:13.949874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae20e5-eff2-4ec7-af9b-ded84de3d16d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:13.949874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae20e5-eff2-4ec7-af9b-ded84de3d16d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:13.949874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae20e5-eff2-4ec7-af9b-ded84de3d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:13.954939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:13.968884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-60ae20e5-eff2-4ec7-af9b-ded84de3d16d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:13.970201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-60ae20e5-eff2-4ec7-af9b-ded84de3d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:14.009824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ad09-9877-4832-a9eb-f9ce9745aff5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:14.052589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8baae-b67b-4e55-b26c-1d9e009ed516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:14.053392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8baae-b67b-4e55-b26c-1d9e009ed516 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:14.057049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8baae-b67b-4e55-b26c-1d9e009ed516 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:14.057158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 180/361] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:14.057234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8baae-b67b-4e55-b26c-1d9e009ed516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:14.057316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae20e5-eff2-4ec7-af9b-ded84de3d16d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:14.070771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:14.138196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8baae-b67b-4e55-b26c-1d9e009ed516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:14.139697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8baae-b67b-4e55-b26c-1d9e009ed516 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:14.180875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae20e5-eff2-4ec7-af9b-ded84de3d16d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:14.227675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97a323-b5df-4da0-9ce8-2946861fe4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:14.228347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a323-b5df-4da0-9ce8-2946861fe4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:14.228679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a323-b5df-4da0-9ce8-2946861fe4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:14.229299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a323-b5df-4da0-9ce8-2946861fe4c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:14.232864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:14.258767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 182/362] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:14.260213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8baae-b67b-4e55-b26c-1d9e009ed516 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:14.304158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:14.329765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97a323-b5df-4da0-9ce8-2946861fe4c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:14.331339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97a323-b5df-4da0-9ce8-2946861fe4c8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:14.378593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8baae-b67b-4e55-b26c-1d9e009ed516 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:14.417614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:14.418265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:14.418539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:14.418814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:14.419562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:14.419864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:14.421699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:14.432500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 183/363] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:14.433501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:14.462588 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 181/364] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:14.463781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97a323-b5df-4da0-9ce8-2946861fe4c8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:14.512958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:14.561012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:14.564395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec1bb7-5eac-4c5c-b7ef-36f55cd5431d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:14.612771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102082c4-d1f6-4d62-9e27-69b7e81c8afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:14.613657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102082c4-d1f6-4d62-9e27-69b7e81c8afe None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:14.614725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102082c4-d1f6-4d62-9e27-69b7e81c8afe None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:14.614725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102082c4-d1f6-4d62-9e27-69b7e81c8afe None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:14.615815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102082c4-d1f6-4d62-9e27-69b7e81c8afe None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:14.615932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97a323-b5df-4da0-9ce8-2946861fe4c8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:14.617379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102082c4-d1f6-4d62-9e27-69b7e81c8afe None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:14.619245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 184/365] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:14.619852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102082c4-d1f6-4d62-9e27-69b7e81c8afe None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:14.667151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3abc7-87ef-457a-9b2e-a39927884dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:14.668479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3abc7-87ef-457a-9b2e-a39927884dac None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:14.668705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3abc7-87ef-457a-9b2e-a39927884dac None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:14.668980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3abc7-87ef-457a-9b2e-a39927884dac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:14.684779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3abc7-87ef-457a-9b2e-a39927884dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-fbe3abc7-87ef-457a-9b2e-a39927884dac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:14.690836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:14.691714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:14.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 182/366] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:14.699511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3abc7-87ef-457a-9b2e-a39927884dac None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:14.757580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102082c4-d1f6-4d62-9e27-69b7e81c8afe None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:14.815449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70bf4e-ecda-432b-9698-ca60f201b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:14.816455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70bf4e-ecda-432b-9698-ca60f201b83a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:14.816739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70bf4e-ecda-432b-9698-ca60f201b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:14.817043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70bf4e-ecda-432b-9698-ca60f201b83a None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:14.819759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70bf4e-ecda-432b-9698-ca60f201b83a None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:14.820113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70bf4e-ecda-432b-9698-ca60f201b83a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:14.822421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 185/367] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:14.822902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70bf4e-ecda-432b-9698-ca60f201b83a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:14.837407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:14.847363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3abc7-87ef-457a-9b2e-a39927884dac None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:14.870283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:14.886171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0d60b-2f0c-440b-9df2-0b69607ea538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:14.887375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d60b-2f0c-440b-9df2-0b69607ea538 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:14.887864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d60b-2f0c-440b-9df2-0b69607ea538 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:14.888425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d60b-2f0c-440b-9df2-0b69607ea538 None admin] PATH_INFO: `/v3/users/d0ea88ebdb724c52bf9e3798188de597` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:14.889958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0d60b-2f0c-440b-9df2-0b69607ea538 None admin] RBAC: Authorizing `identity:get_user(user_id=d0ea88ebdb724c52bf9e3798188de597)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:14.891671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0d60b-2f0c-440b-9df2-0b69607ea538 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:14.893925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 183/368] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/users/d0ea88ebdb724c52bf9e3798188de597 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:14.894928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0d60b-2f0c-440b-9df2-0b69607ea538 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:14.952107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70bf4e-ecda-432b-9698-ca60f201b83a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:14.989129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbfd5a-ea28-4ca4-b06a-079eb12d045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:14.990072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfd5a-ea28-4ca4-b06a-079eb12d045f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:14.990351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfd5a-ea28-4ca4-b06a-079eb12d045f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:14.990625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfd5a-ea28-4ca4-b06a-079eb12d045f None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:14.992442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbfd5a-ea28-4ca4-b06a-079eb12d045f None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:14.993965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbfd5a-ea28-4ca4-b06a-079eb12d045f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:14.996059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 186/369] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:14.996906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbfd5a-ea28-4ca4-b06a-079eb12d045f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.020962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0d60b-2f0c-440b-9df2-0b69607ea538 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:15.070153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:15.071080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.071371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.072047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.073172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] RBAC: Adding query filter params (group.id=3ce7be0359614483b555ac166c9d3290, role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=5c75dc25d4a74e258aebc6a53b585817) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:15.073489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:15.075240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:15.083534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 184/370] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/role_assignments?group.id=3ce7be0359614483b555ac166c9d3290&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:15.084795 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.123773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:15.145154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbfd5a-ea28-4ca4-b06a-079eb12d045f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:15.150251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:15.202926 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:15.204354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.204820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.205275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.206271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:15.207415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:15.209543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:15.221316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e196d-7571-453b-8d90-108e66f0f826 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:15.222537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 187/371] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:15.225153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.268190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80140-a0ca-4008-8cc2-9be40e092ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:15.269667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80140-a0ca-4008-8cc2-9be40e092ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.271033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80140-a0ca-4008-8cc2-9be40e092ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.271543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80140-a0ca-4008-8cc2-9be40e092ce7 None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.272965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80140-a0ca-4008-8cc2-9be40e092ce7 None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:15.274660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80140-a0ca-4008-8cc2-9be40e092ce7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:15.277138 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 185/372] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:15 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:15.278300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80140-a0ca-4008-8cc2-9be40e092ce7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.342669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48880c9a-1984-453d-ac96-f8e4be36275f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:15.385302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:15.386033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.386316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.386602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.387448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] RBAC: Adding query filter params (role.id=2affecf7dda148d6a834671d7fa0ef8d, user.id=d0ea88ebdb724c52bf9e3798188de597, scope.system=all) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:15.387762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:15.389277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:15.395979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:15.401827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 188/373] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jun 23 16:59:15 2022] GET /identity/v3/role_assignments?user.id=d0ea88ebdb724c52bf9e3798188de597&scope.system=all&role.id=2affecf7dda148d6a834671d7fa0ef8d => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:15.402479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.413826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80140-a0ca-4008-8cc2-9be40e092ce7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:15.432392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:15.477778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee23b9-4971-49ae-8665-f62dad143d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:15.480712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee23b9-4971-49ae-8665-f62dad143d08 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.481427 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee23b9-4971-49ae-8665-f62dad143d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.482151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee23b9-4971-49ae-8665-f62dad143d08 None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.485600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee23b9-4971-49ae-8665-f62dad143d08 None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:15.488635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee23b9-4971-49ae-8665-f62dad143d08 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:15.492294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 186/374] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:15 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:15.493986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee23b9-4971-49ae-8665-f62dad143d08 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.522188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c877-84f7-488d-9f30-f4e6f67a9000 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:15.560877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e7353-8f5a-42fa-bcce-f6221e19d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:15.561535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7353-8f5a-42fa-bcce-f6221e19d40c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.561917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7353-8f5a-42fa-bcce-f6221e19d40c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.562201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7353-8f5a-42fa-bcce-f6221e19d40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.634244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee23b9-4971-49ae-8665-f62dad143d08 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:15.642409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e7353-8f5a-42fa-bcce-f6221e19d40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:15.643863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e7353-8f5a-42fa-bcce-f6221e19d40c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:15.677054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:15.684018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d2c0a-b3bb-4242-8fa6-382e3c062362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:15.684687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2c0a-b3bb-4242-8fa6-382e3c062362 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.684962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2c0a-b3bb-4242-8fa6-382e3c062362 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.685231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d2c0a-b3bb-4242-8fa6-382e3c062362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.686101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d2c0a-b3bb-4242-8fa6-382e3c062362 None admin] RBAC: Adding query filter params (group.id=3ce7be0359614483b555ac166c9d3290, role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=a54cac18fe3448119899dcb53a77d938) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:15.686409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d2c0a-b3bb-4242-8fa6-382e3c062362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:15.687854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d2c0a-b3bb-4242-8fa6-382e3c062362 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:15.696812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 187/375] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:15 2022] GET /identity/v3/role_assignments?group.id=3ce7be0359614483b555ac166c9d3290&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=de3989d133584bab8378c170cee57ac6 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:15.698803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f76d3-03d9-4c17-947a-e92de9fce148 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.698803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f76d3-03d9-4c17-947a-e92de9fce148 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.698991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f76d3-03d9-4c17-947a-e92de9fce148 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.701312 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 188/376] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:15.702091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f76d3-03d9-4c17-947a-e92de9fce148 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.737956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:15.799846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 189/377] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:15.801243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d898cc-a54f-4d9c-a105-7a7a838cb65c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.801535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d898cc-a54f-4d9c-a105-7a7a838cb65c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.801827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d898cc-a54f-4d9c-a105-7a7a838cb65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.822051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-65d898cc-a54f-4d9c-a105-7a7a838cb65c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:15.823286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-65d898cc-a54f-4d9c-a105-7a7a838cb65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:15.847046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f76d3-03d9-4c17-947a-e92de9fce148 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:15.894818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:15.895557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:15.895883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:15.896237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:15.897324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] RBAC: Adding query filter params (group.id=3ce7be0359614483b555ac166c9d3290, role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=5c75dc25d4a74e258aebc6a53b585817) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:15.897638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:15.899537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:15.901887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 190/378] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:15.902768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d898cc-a54f-4d9c-a105-7a7a838cb65c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.906923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 189/379] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:15 2022] GET /identity/v3/role_assignments?group.id=3ce7be0359614483b555ac166c9d3290&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=de3989d133584bab8378c170cee57ac6 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:15.930950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:15.977829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:16.029674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d898cc-a54f-4d9c-a105-7a7a838cb65c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:16.041452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:16.052134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112373a-79d4-49f8-a24d-7a21d716a3c0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:16.069527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256da95-89ba-47a1-bfe4-abbc5a5b086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:16.070534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256da95-89ba-47a1-bfe4-abbc5a5b086d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:16.070819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256da95-89ba-47a1-bfe4-abbc5a5b086d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:16.071096 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256da95-89ba-47a1-bfe4-abbc5a5b086d None admin] PATH_INFO: `/v3/projects/817b32abe9534b1196adc7d371e17f3c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:16.072421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256da95-89ba-47a1-bfe4-abbc5a5b086d None admin] RBAC: Authorizing `identity:get_project(project_id=817b32abe9534b1196adc7d371e17f3c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:16.073902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256da95-89ba-47a1-bfe4-abbc5a5b086d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:16.075922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 191/380] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:15 2022] GET /identity/v3/projects/817b32abe9534b1196adc7d371e17f3c => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:16.082469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256da95-89ba-47a1-bfe4-abbc5a5b086d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:16.091102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f28d42-5756-4c6d-9a0e-403b31fd8d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:16.091910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f28d42-5756-4c6d-9a0e-403b31fd8d62 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:16.092219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f28d42-5756-4c6d-9a0e-403b31fd8d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:16.092619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f28d42-5756-4c6d-9a0e-403b31fd8d62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:16.104868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f28d42-5756-4c6d-9a0e-403b31fd8d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-67f28d42-5756-4c6d-9a0e-403b31fd8d62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:16.114607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:16.115678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:16.118008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 190/381] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:16.130866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f28d42-5756-4c6d-9a0e-403b31fd8d62 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:16.202879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256da95-89ba-47a1-bfe4-abbc5a5b086d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:16.229453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:16.247572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c38e-be91-4206-85df-540d287f0fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:16.248452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c38e-be91-4206-85df-540d287f0fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:16.248737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c38e-be91-4206-85df-540d287f0fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:16.249009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c38e-be91-4206-85df-540d287f0fd7 None admin] PATH_INFO: `/v3/groups/28a8562321054d4681442e4c238afff7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:16.262567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55c38e-be91-4206-85df-540d287f0fd7 None admin] RBAC: Authorizing `identity:get_group(group_id=28a8562321054d4681442e4c238afff7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:16.264042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55c38e-be91-4206-85df-540d287f0fd7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:16.266166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 192/382] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:16 2022] GET /identity/v3/groups/28a8562321054d4681442e4c238afff7 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:16.272492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c38e-be91-4206-85df-540d287f0fd7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:16.304549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f28d42-5756-4c6d-9a0e-403b31fd8d62 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:16.371327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:16.372053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:16.372331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:16.372604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:16.373356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:16.373658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:16.375078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:16.393900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 191/383] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:16.399465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:16.424151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:16.450891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c38e-be91-4206-85df-540d287f0fd7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:16.527540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:16.529617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:16.530075 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:16.530390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:16.531234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] RBAC: Adding query filter params (group.id=28a8562321054d4681442e4c238afff7, role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=817b32abe9534b1196adc7d371e17f3c) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:16.531543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:16.532993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:16.555703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 193/384] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:16 2022] GET /identity/v3/role_assignments?group.id=28a8562321054d4681442e4c238afff7&scope.project.id=817b32abe9534b1196adc7d371e17f3c&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:16.589639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f79fd6-2da6-4ab4-a8f1-72c06d7e170e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:16.647656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f0e85-9482-4d82-8a2d-3e274422aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:16.648601 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f0e85-9482-4d82-8a2d-3e274422aa61 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:16.648882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f0e85-9482-4d82-8a2d-3e274422aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:16.649157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f0e85-9482-4d82-8a2d-3e274422aa61 None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:16.650501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f0e85-9482-4d82-8a2d-3e274422aa61 None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:16.652034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f0e85-9482-4d82-8a2d-3e274422aa61 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:16.654021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 192/385] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:16 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:16.660011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:16.717457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:16.784695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35208aee-0234-4dff-9667-3b88b081be12 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:16.838572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e5646-4ee2-4dc4-9433-64872ffa7874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:16.839368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5646-4ee2-4dc4-9433-64872ffa7874 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:16.839649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5646-4ee2-4dc4-9433-64872ffa7874 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:16.839924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e5646-4ee2-4dc4-9433-64872ffa7874 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:16.841539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e5646-4ee2-4dc4-9433-64872ffa7874 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:16.843909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e5646-4ee2-4dc4-9433-64872ffa7874 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:16.853342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 194/386] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:16 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:16.855110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f0e85-9482-4d82-8a2d-3e274422aa61 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:16.970899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:16.997344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f0e85-9482-4d82-8a2d-3e274422aa61 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:17.034946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfde35-c8df-4fa5-85b3-a2406c0b6ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:17.035845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfde35-c8df-4fa5-85b3-a2406c0b6ba5 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:17.036129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfde35-c8df-4fa5-85b3-a2406c0b6ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:17.036402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfde35-c8df-4fa5-85b3-a2406c0b6ba5 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938/groups/3ce7be0359614483b555ac166c9d3290/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:17.038528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfde35-c8df-4fa5-85b3-a2406c0b6ba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a54cac18fe3448119899dcb53a77d938, group_id=3ce7be0359614483b555ac166c9d3290, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:17.039988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfde35-c8df-4fa5-85b3-a2406c0b6ba5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:17.056811 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 193/387] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 23 16:59:16 2022] PUT /identity/v3/projects/a54cac18fe3448119899dcb53a77d938/groups/3ce7be0359614483b555ac166c9d3290/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:17.484998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac9e3-880d-4c77-ba6a-ae2ee0a56e76 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:17.485882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac9e3-880d-4c77-ba6a-ae2ee0a56e76 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:17.486335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac9e3-880d-4c77-ba6a-ae2ee0a56e76 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:17.488119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 195/388] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:17.494209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022092-f5a0-4c06-ba8f-8e41c91e8f9d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:17.494988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022092-f5a0-4c06-ba8f-8e41c91e8f9d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:17.495404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022092-f5a0-4c06-ba8f-8e41c91e8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:17.522822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-98022092-f5a0-4c06-ba8f-8e41c91e8f9d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:17.524305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-98022092-f5a0-4c06-ba8f-8e41c91e8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:17.600228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 194/389] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:17.622419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac9e3-880d-4c77-ba6a-ae2ee0a56e76 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:17.764395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac9e3-880d-4c77-ba6a-ae2ee0a56e76 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:17.792138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:17.811630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c8d9-7c26-4995-a03d-9fa13f706178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:17.812438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c8d9-7c26-4995-a03d-9fa13f706178 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:17.812715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c8d9-7c26-4995-a03d-9fa13f706178 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:17.812989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0c8d9-7c26-4995-a03d-9fa13f706178 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:17.830641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0c8d9-7c26-4995-a03d-9fa13f706178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fee0c8d9-7c26-4995-a03d-9fa13f706178 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:17.838476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:17.839361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:17.840161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 196/390] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:17.847287 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98022092-f5a0-4c06-ba8f-8e41c91e8f9d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:17.965149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:18.001832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98022092-f5a0-4c06-ba8f-8e41c91e8f9d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:18.042464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:18.043158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.043437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.043718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.044465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:18.044771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:18.046189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:18.057258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 195/391] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:18.063158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c8d9-7c26-4995-a03d-9fa13f706178 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:18.193634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0c8d9-7c26-4995-a03d-9fa13f706178 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:18.227456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b37ae-5ed3-4079-9597-3f6e79b40b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:18.228324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b37ae-5ed3-4079-9597-3f6e79b40b90 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.228603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b37ae-5ed3-4079-9597-3f6e79b40b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.228873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b37ae-5ed3-4079-9597-3f6e79b40b90 None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.230091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b37ae-5ed3-4079-9597-3f6e79b40b90 None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:18.231526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b37ae-5ed3-4079-9597-3f6e79b40b90 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:18.233516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 197/392] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:18 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:18.238827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:18.316852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d819be-edc8-4f4c-8d57-39106b831766 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.317020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d819be-edc8-4f4c-8d57-39106b831766 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.317285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d819be-edc8-4f4c-8d57-39106b831766 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.319089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 198/393] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:18.324253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b8d13-6153-47fb-ab7d-252c535592b4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.324537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b8d13-6153-47fb-ab7d-252c535592b4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.324814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b8d13-6153-47fb-ab7d-252c535592b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.343676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-571b8d13-6153-47fb-ab7d-252c535592b4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:18.344868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-571b8d13-6153-47fb-ab7d-252c535592b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:18.402147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:18.407937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6eac4-0da3-462d-b891-1d769784bd48 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:18.426524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 199/394] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:18.448378 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b8d13-6153-47fb-ab7d-252c535592b4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:18.477526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:18.485927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d08afd-ae35-465f-b9fa-e1a7af4e735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:18.486822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08afd-ae35-465f-b9fa-e1a7af4e735b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.487102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08afd-ae35-465f-b9fa-e1a7af4e735b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.487376 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08afd-ae35-465f-b9fa-e1a7af4e735b None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.494875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d08afd-ae35-465f-b9fa-e1a7af4e735b None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:18.497182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d08afd-ae35-465f-b9fa-e1a7af4e735b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:18.499614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 196/395] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:18 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:18.505944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d08afd-ae35-465f-b9fa-e1a7af4e735b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:18.599344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b8d13-6153-47fb-ab7d-252c535592b4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:18.643445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4290a-1ca0-47a5-97e7-8d2e331f40e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:18.644556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4290a-1ca0-47a5-97e7-8d2e331f40e0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.644975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4290a-1ca0-47a5-97e7-8d2e331f40e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.645407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4290a-1ca0-47a5-97e7-8d2e331f40e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.657284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4290a-1ca0-47a5-97e7-8d2e331f40e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-94c4290a-1ca0-47a5-97e7-8d2e331f40e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:18.666394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:18.667555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:18.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:18.675814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 200/396] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:18.676921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d08afd-ae35-465f-b9fa-e1a7af4e735b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:18.677880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15ec0-36e3-42eb-8bc3-22ebd9eec67f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.678322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15ec0-36e3-42eb-8bc3-22ebd9eec67f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.678732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15ec0-36e3-42eb-8bc3-22ebd9eec67f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.680461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 201/397] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:18.681732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce15ec0-36e3-42eb-8bc3-22ebd9eec67f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:18.721930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95311ee8-bee1-411e-80a1-328562d6eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:18.723118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95311ee8-bee1-411e-80a1-328562d6eb62 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.723407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95311ee8-bee1-411e-80a1-328562d6eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.723680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95311ee8-bee1-411e-80a1-328562d6eb62 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817/groups/3ce7be0359614483b555ac166c9d3290/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.726271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95311ee8-bee1-411e-80a1-328562d6eb62 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c75dc25d4a74e258aebc6a53b585817, group_id=3ce7be0359614483b555ac166c9d3290, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:18.729005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95311ee8-bee1-411e-80a1-328562d6eb62 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:18.733475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:18.749847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 197/398] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 23 16:59:18 2022] PUT /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817/groups/3ce7be0359614483b555ac166c9d3290/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:59:18.752211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880e462-6811-4bce-845d-d5627ff8f4f2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.752778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880e462-6811-4bce-845d-d5627ff8f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.753321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880e462-6811-4bce-845d-d5627ff8f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.777529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d880e462-6811-4bce-845d-d5627ff8f4f2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:18.779223 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d880e462-6811-4bce-845d-d5627ff8f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:18.811294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce15ec0-36e3-42eb-8bc3-22ebd9eec67f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:18.855014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:18.855603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:18.856343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:18.856634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:18.858148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:18.858702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:18.859819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:18.862058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:18.875847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 198/399] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:18.876986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 202/400] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:18.883232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880e462-6811-4bce-845d-d5627ff8f4f2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:18.910354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.037884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:19.044059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ac12f-ad79-41d2-9050-d9591f4b9749 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.050323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880e462-6811-4bce-845d-d5627ff8f4f2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.090699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601159d-d2e8-44e4-b34c-5cebbe31bff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.091766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601159d-d2e8-44e4-b34c-5cebbe31bff2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.092053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951830-8d08-4ee4-8199-aa42b8c98bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.092380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601159d-d2e8-44e4-b34c-5cebbe31bff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.092806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601159d-d2e8-44e4-b34c-5cebbe31bff2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.093201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951830-8d08-4ee4-8199-aa42b8c98bca None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.093596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951830-8d08-4ee4-8199-aa42b8c98bca None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.093991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5951830-8d08-4ee4-8199-aa42b8c98bca None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.096552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5951830-8d08-4ee4-8199-aa42b8c98bca None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:19.098103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5951830-8d08-4ee4-8199-aa42b8c98bca None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:19.099890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 199/401] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:18 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:19.105527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601159d-d2e8-44e4-b34c-5cebbe31bff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:19.106352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951830-8d08-4ee4-8199-aa42b8c98bca None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d601159d-d2e8-44e4-b34c-5cebbe31bff2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:19.115727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:19.116848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:19.117871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:19.119473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 203/402] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:19.126233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601159d-d2e8-44e4-b34c-5cebbe31bff2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.176554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:19.220805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5951830-8d08-4ee4-8199-aa42b8c98bca None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.249227 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601159d-d2e8-44e4-b34c-5cebbe31bff2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.255414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b29c-4d85-4182-849d-5b1e4b6f6d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.256349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b29c-4d85-4182-849d-5b1e4b6f6d95 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.256624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b29c-4d85-4182-849d-5b1e4b6f6d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.256897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b29c-4d85-4182-849d-5b1e4b6f6d95 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.265818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b29c-4d85-4182-849d-5b1e4b6f6d95 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:19.265818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b29c-4d85-4182-849d-5b1e4b6f6d95 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:19.266066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 200/403] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:19 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:19.267482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b29c-4d85-4182-849d-5b1e4b6f6d95 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.316317 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42679748-a17d-40af-bd12-95f25ef3d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.317414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42679748-a17d-40af-bd12-95f25ef3d311 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.317979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42679748-a17d-40af-bd12-95f25ef3d311 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.318463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42679748-a17d-40af-bd12-95f25ef3d311 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.319440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42679748-a17d-40af-bd12-95f25ef3d311 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:19.319960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42679748-a17d-40af-bd12-95f25ef3d311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:19.326191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42679748-a17d-40af-bd12-95f25ef3d311 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:19.336231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 204/404] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:19.337651 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa166c-5dc0-47c5-9b6d-b32e2bfc3227 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.337993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa166c-5dc0-47c5-9b6d-b32e2bfc3227 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.338271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa166c-5dc0-47c5-9b6d-b32e2bfc3227 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.343884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 205/405] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:19.344723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa166c-5dc0-47c5-9b6d-b32e2bfc3227 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.370870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:19.404178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b29c-4d85-4182-849d-5b1e4b6f6d95 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.437672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:19.449120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ad6ec-1fa4-41a5-816b-ff0b35b83d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.450472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad6ec-1fa4-41a5-816b-ff0b35b83d44 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.450858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad6ec-1fa4-41a5-816b-ff0b35b83d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.451234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad6ec-1fa4-41a5-816b-ff0b35b83d44 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938/groups/3ce7be0359614483b555ac166c9d3290/roles/de3989d133584bab8378c170cee57ac6` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.454369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ad6ec-1fa4-41a5-816b-ff0b35b83d44 None admin] RBAC: Authorizing `identity:create_grant(project_id=a54cac18fe3448119899dcb53a77d938, group_id=3ce7be0359614483b555ac166c9d3290, role_id=de3989d133584bab8378c170cee57ac6)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:19.455833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ad6ec-1fa4-41a5-816b-ff0b35b83d44 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:19.472699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa166c-5dc0-47c5-9b6d-b32e2bfc3227 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.477902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 201/406] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 23 16:59:19 2022] PUT /identity/v3/projects/a54cac18fe3448119899dcb53a77d938/groups/3ce7be0359614483b555ac166c9d3290/roles/de3989d133584bab8378c170cee57ac6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:59:19.479767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cddbf-8ccd-4b23-8af5-69c66dc27a92 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.480297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cddbf-8ccd-4b23-8af5-69c66dc27a92 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.480866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cddbf-8ccd-4b23-8af5-69c66dc27a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.521670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0f3cddbf-8ccd-4b23-8af5-69c66dc27a92 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:19.523829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0f3cddbf-8ccd-4b23-8af5-69c66dc27a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:19.540603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2122b-d875-4d7a-afd2-8c13054ad9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.541571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2122b-d875-4d7a-afd2-8c13054ad9ad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.541901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2122b-d875-4d7a-afd2-8c13054ad9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.542203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2122b-d875-4d7a-afd2-8c13054ad9ad None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.544486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2122b-d875-4d7a-afd2-8c13054ad9ad None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:19.546039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2122b-d875-4d7a-afd2-8c13054ad9ad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:19.549653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 206/407] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:19 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:19.557750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2122b-d875-4d7a-afd2-8c13054ad9ad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.643637 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 202/408] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:19.645325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c1bc-ba35-4bd9-a222-68327654a647 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.645614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c1bc-ba35-4bd9-a222-68327654a647 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.645918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c1bc-ba35-4bd9-a222-68327654a647 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.648477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 203/409] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:19.654123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0835-5af8-4912-8204-8df03631cd83 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.654412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0835-5af8-4912-8204-8df03631cd83 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.654690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac0835-5af8-4912-8204-8df03631cd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.672551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:19.673973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-75ac0835-5af8-4912-8204-8df03631cd83 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:19.675210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-75ac0835-5af8-4912-8204-8df03631cd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:19.685479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2122b-d875-4d7a-afd2-8c13054ad9ad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.725392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a447-19c3-405f-8e72-cb271e2f5bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.725753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a447-19c3-405f-8e72-cb271e2f5bef None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.726043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a447-19c3-405f-8e72-cb271e2f5bef None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.726216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852a447-19c3-405f-8e72-cb271e2f5bef None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.727678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852a447-19c3-405f-8e72-cb271e2f5bef None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:19.729159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852a447-19c3-405f-8e72-cb271e2f5bef None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:19.731235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:19 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:19.736431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a447-19c3-405f-8e72-cb271e2f5bef None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.760715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 204/411] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:19.769904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac0835-5af8-4912-8204-8df03631cd83 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.835340 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:19.885998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852a447-19c3-405f-8e72-cb271e2f5bef None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.901807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac0835-5af8-4912-8204-8df03631cd83 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:19.923714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92e6e-9c48-4db2-a3c7-2ee5295881e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.924904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92e6e-9c48-4db2-a3c7-2ee5295881e4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.925379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92e6e-9c48-4db2-a3c7-2ee5295881e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.925902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92e6e-9c48-4db2-a3c7-2ee5295881e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.937418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92e6e-9c48-4db2-a3c7-2ee5295881e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:19.945386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976084f0-ecd7-4842-8c84-4fd403939003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-86b92e6e-9c48-4db2-a3c7-2ee5295881e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:19.946189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:19.947102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:19.947896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:19.948502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976084f0-ecd7-4842-8c84-4fd403939003 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:19.948502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976084f0-ecd7-4842-8c84-4fd403939003 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:19.948502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976084f0-ecd7-4842-8c84-4fd403939003 None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817/groups/3ce7be0359614483b555ac166c9d3290/roles/de3989d133584bab8378c170cee57ac6` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:19.953927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 208/412] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:19.954045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976084f0-ecd7-4842-8c84-4fd403939003 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c75dc25d4a74e258aebc6a53b585817, group_id=3ce7be0359614483b555ac166c9d3290, role_id=de3989d133584bab8378c170cee57ac6)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:19.954122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92e6e-9c48-4db2-a3c7-2ee5295881e4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.954210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976084f0-ecd7-4842-8c84-4fd403939003 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:19.974673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 205/413] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 23 16:59:19 2022] PUT /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817/groups/3ce7be0359614483b555ac166c9d3290/roles/de3989d133584bab8378c170cee57ac6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:19.976037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976084f0-ecd7-4842-8c84-4fd403939003 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:19.983713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:20.122941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976084f0-ecd7-4842-8c84-4fd403939003 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:20.138199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:20.157953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92e6e-9c48-4db2-a3c7-2ee5295881e4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:20.207743 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddd254-5e20-489a-93ca-2f00af337a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:20.208638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd254-5e20-489a-93ca-2f00af337a75 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:20.209037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd254-5e20-489a-93ca-2f00af337a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:20.209481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd254-5e20-489a-93ca-2f00af337a75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:20.211166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:20.212038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:20.212314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:20.212593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:20.213426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:20.213932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:20.216211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:20.229940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 206/414] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:20.239533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdddd254-5e20-489a-93ca-2f00af337a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:20.239985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fdddd254-5e20-489a-93ca-2f00af337a75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:20.249089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:20.250041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:20.251706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:20.254531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 209/415] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:20.262791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddd254-5e20-489a-93ca-2f00af337a75 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:20.351746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:20.357201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60924d-f325-4c7b-84f9-41b1434211d7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:20.383985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddd254-5e20-489a-93ca-2f00af337a75 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:20.398729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e9a20-df04-4c9d-abb4-ea974a7cfe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:20.400007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e9a20-df04-4c9d-abb4-ea974a7cfe7a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:20.400505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e9a20-df04-4c9d-abb4-ea974a7cfe7a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:20.401094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e9a20-df04-4c9d-abb4-ea974a7cfe7a None admin] PATH_INFO: `/v3/groups/28a8562321054d4681442e4c238afff7` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:20.402516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e9a20-df04-4c9d-abb4-ea974a7cfe7a None admin] RBAC: Authorizing `identity:get_group(group_id=28a8562321054d4681442e4c238afff7)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:20.404349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e9a20-df04-4c9d-abb4-ea974a7cfe7a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:20.406508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 207/416] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:20 2022] GET /identity/v3/groups/28a8562321054d4681442e4c238afff7 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:20.412391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e9a20-df04-4c9d-abb4-ea974a7cfe7a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:20.422478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:20.423162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:20.423444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:20.423720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:20.424480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:20.424790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:20.426509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:20.437653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 210/417] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:20.448552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:20.465817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:20.530289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e9a20-df04-4c9d-abb4-ea974a7cfe7a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:20.567068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851019f-a3ad-49f9-a920-111fe3c425c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:20.568203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851019f-a3ad-49f9-a920-111fe3c425c6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:20.568762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851019f-a3ad-49f9-a920-111fe3c425c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:20.569077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851019f-a3ad-49f9-a920-111fe3c425c6 None admin] PATH_INFO: `/v3/projects/817b32abe9534b1196adc7d371e17f3c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:20.570476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851019f-a3ad-49f9-a920-111fe3c425c6 None admin] RBAC: Authorizing `identity:get_project(project_id=817b32abe9534b1196adc7d371e17f3c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:20.572192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851019f-a3ad-49f9-a920-111fe3c425c6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:20.580945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 208/418] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:20 2022] GET /identity/v3/projects/817b32abe9534b1196adc7d371e17f3c => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:20.587175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851019f-a3ad-49f9-a920-111fe3c425c6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:20.619187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8611b-03ed-4110-a317-ccabc7aff756 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:20.669574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9848566-ddf5-478b-af05-c0e6d5e4f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:20.671321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848566-ddf5-478b-af05-c0e6d5e4f770 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:20.671824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848566-ddf5-478b-af05-c0e6d5e4f770 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:20.672292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9848566-ddf5-478b-af05-c0e6d5e4f770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:20.713774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:20.777464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851019f-a3ad-49f9-a920-111fe3c425c6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:20.781190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:20.819011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9848566-ddf5-478b-af05-c0e6d5e4f770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:20.820702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9848566-ddf5-478b-af05-c0e6d5e4f770 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:20.868358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830d457-c1ad-45d4-a8d5-5e2b3dc5cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:20.869659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d457-c1ad-45d4-a8d5-5e2b3dc5cc80 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:20.869971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d457-c1ad-45d4-a8d5-5e2b3dc5cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:20.870244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d457-c1ad-45d4-a8d5-5e2b3dc5cc80 None admin] PATH_INFO: `/v3/projects/817b32abe9534b1196adc7d371e17f3c/groups/28a8562321054d4681442e4c238afff7/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:20.872224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830d457-c1ad-45d4-a8d5-5e2b3dc5cc80 None admin] RBAC: Authorizing `identity:create_grant(project_id=817b32abe9534b1196adc7d371e17f3c, group_id=28a8562321054d4681442e4c238afff7, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:20.873678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830d457-c1ad-45d4-a8d5-5e2b3dc5cc80 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:20.910595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 209/419] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jun 23 16:59:20 2022] PUT /identity/v3/projects/817b32abe9534b1196adc7d371e17f3c/groups/28a8562321054d4681442e4c238afff7/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:59:20.979011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 211/420] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:20.984909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830d457-c1ad-45d4-a8d5-5e2b3dc5cc80 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:21.127180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830d457-c1ad-45d4-a8d5-5e2b3dc5cc80 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:21.164775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94891f65-c46b-49d8-9862-dcdc6ef06a55 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.165122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94891f65-c46b-49d8-9862-dcdc6ef06a55 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.165336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94891f65-c46b-49d8-9862-dcdc6ef06a55 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:21.166971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 212/421] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:21.174325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb16b5-054b-4e9b-b300-b34c5223e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:21.175284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb16b5-054b-4e9b-b300-b34c5223e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.175563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb16b5-054b-4e9b-b300-b34c5223e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.175886 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb16b5-054b-4e9b-b300-b34c5223e9f7 None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:21.177117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb16b5-054b-4e9b-b300-b34c5223e9f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:21.178495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7b04-c102-4b1a-a083-8c92a9ad4429 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.178787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7b04-c102-4b1a-a083-8c92a9ad4429 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.179069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd7b04-c102-4b1a-a083-8c92a9ad4429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:21.179516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb16b5-054b-4e9b-b300-b34c5223e9f7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:21.181593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 210/422] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:20 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:21.187147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb16b5-054b-4e9b-b300-b34c5223e9f7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:21.217533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-41bd7b04-c102-4b1a-a083-8c92a9ad4429 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:21.218802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-41bd7b04-c102-4b1a-a083-8c92a9ad4429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:21.254249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:21.270556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:21.340919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 213/423] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:21.367767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb16b5-054b-4e9b-b300-b34c5223e9f7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:21.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd7b04-c102-4b1a-a083-8c92a9ad4429 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:21.408715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be3d11-c1ad-4fd9-8068-599276481ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:21.409602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be3d11-c1ad-4fd9-8068-599276481ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.409915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be3d11-c1ad-4fd9-8068-599276481ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.410194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be3d11-c1ad-4fd9-8068-599276481ff0 None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:21.411399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be3d11-c1ad-4fd9-8068-599276481ff0 None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:21.412916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be3d11-c1ad-4fd9-8068-599276481ff0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:21.414939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 211/424] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:21 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:21.421444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be3d11-c1ad-4fd9-8068-599276481ff0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:21.543681 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd7b04-c102-4b1a-a083-8c92a9ad4429 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:21.613164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:21.617183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be3d11-c1ad-4fd9-8068-599276481ff0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:21.628032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b73c-e542-49ed-af18-333b25904187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:21.628917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b73c-e542-49ed-af18-333b25904187 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.629161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b73c-e542-49ed-af18-333b25904187 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.629436 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b73c-e542-49ed-af18-333b25904187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:21.645698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82b73c-e542-49ed-af18-333b25904187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0d82b73c-e542-49ed-af18-333b25904187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:21.654384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:21.655311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:21.656142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 214/425] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:21.663007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b73c-e542-49ed-af18-333b25904187 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:21.665396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:21.666440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.667008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.667471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:21.668491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] RBAC: Adding query filter params (group.id=3ce7be0359614483b555ac166c9d3290, role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=a54cac18fe3448119899dcb53a77d938) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:21.668992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:21.670763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:21.678183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 212/426] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:21 2022] GET /identity/v3/role_assignments?group.id=3ce7be0359614483b555ac166c9d3290&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 611 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:21.724522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:21.847423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b73c-e542-49ed-af18-333b25904187 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:21.893411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358d70-b64b-4896-8ba3-c8fba506222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:21.894121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358d70-b64b-4896-8ba3-c8fba506222f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.894407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358d70-b64b-4896-8ba3-c8fba506222f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.894687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358d70-b64b-4896-8ba3-c8fba506222f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:21.895454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358d70-b64b-4896-8ba3-c8fba506222f None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:21.895764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358d70-b64b-4896-8ba3-c8fba506222f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:21.897322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358d70-b64b-4896-8ba3-c8fba506222f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:21.906302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 215/427] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 16:59:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:21.911964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:21.978488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438aa0-9c01-4a26-be97-c70f82ea18e9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.978835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438aa0-9c01-4a26-be97-c70f82ea18e9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.979053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438aa0-9c01-4a26-be97-c70f82ea18e9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:21.980563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 216/428] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:21.985636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170222-b053-45ff-b15a-2875db7d36cf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:21.986176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170222-b053-45ff-b15a-2875db7d36cf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:21.986641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170222-b053-45ff-b15a-2875db7d36cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.010121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-04170222-b053-45ff-b15a-2875db7d36cf None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:22.012430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-04170222-b053-45ff-b15a-2875db7d36cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:22.033056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dded92f-49cc-4fd9-beef-e3c05b198ed0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:22.079486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02450582-7f31-40b5-a071-46819c996dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:22.080551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02450582-7f31-40b5-a071-46819c996dcb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.081375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02450582-7f31-40b5-a071-46819c996dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.081847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02450582-7f31-40b5-a071-46819c996dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.110546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 217/429] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:22.126971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:22.139123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04170222-b053-45ff-b15a-2875db7d36cf None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:22.167208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:22.189496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02450582-7f31-40b5-a071-46819c996dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:22.191525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02450582-7f31-40b5-a071-46819c996dcb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:22.270202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04170222-b053-45ff-b15a-2875db7d36cf None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:22.304694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 213/430] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:22.307556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41bef-b970-4984-aef9-862e668e695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:22.308637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41bef-b970-4984-aef9-862e668e695e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.309184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41bef-b970-4984-aef9-862e668e695e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.309643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41bef-b970-4984-aef9-862e668e695e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.310385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02450582-7f31-40b5-a071-46819c996dcb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:22.322010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe41bef-b970-4984-aef9-862e668e695e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6fe41bef-b970-4984-aef9-862e668e695e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:22.331512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:22.332415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:22.333248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:22.337168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 218/431] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:59:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:22.343150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41bef-b970-4984-aef9-862e668e695e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:22.376610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:22.418107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02450582-7f31-40b5-a071-46819c996dcb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:22.436797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:22.460309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe41bef-b970-4984-aef9-862e668e695e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:22.462220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c931f-b8ac-41fd-8e06-b9ae20137ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:22.463366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c931f-b8ac-41fd-8e06-b9ae20137ffe None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.463883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c931f-b8ac-41fd-8e06-b9ae20137ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.464355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c931f-b8ac-41fd-8e06-b9ae20137ffe None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.465772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c931f-b8ac-41fd-8e06-b9ae20137ffe None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:22.467502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c931f-b8ac-41fd-8e06-b9ae20137ffe None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:22.469841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 214/432] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:22 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:22.475900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c931f-b8ac-41fd-8e06-b9ae20137ffe None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:22.497725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:22.498441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.498718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.498989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.499847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:22.500156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:22.501536 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:22.512465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 219/433] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:22.518059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:22.592669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c931f-b8ac-41fd-8e06-b9ae20137ffe None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:22.624294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:22.631745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ae78-5707-40b2-8496-6e153754f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:22.632918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ae78-5707-40b2-8496-6e153754f3fd None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.633415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ae78-5707-40b2-8496-6e153754f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.633938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f76ec-53cd-4311-8402-bddb850b9d80 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:22.634159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ae78-5707-40b2-8496-6e153754f3fd None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.635724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ae78-5707-40b2-8496-6e153754f3fd None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:22.637531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ae78-5707-40b2-8496-6e153754f3fd None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:22.639770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 215/434] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:22 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:22.645833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ae78-5707-40b2-8496-6e153754f3fd None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:22.672321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fc605-2448-45df-826f-7ac7aebca1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:22.673054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc605-2448-45df-826f-7ac7aebca1df None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.673397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc605-2448-45df-826f-7ac7aebca1df None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.673604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc605-2448-45df-826f-7ac7aebca1df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.693887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:22.753868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fc605-2448-45df-826f-7ac7aebca1df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:22.755667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fc605-2448-45df-826f-7ac7aebca1df None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:22.760924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ae78-5707-40b2-8496-6e153754f3fd None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:22.802035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7651fb-0de4-49a4-9cbf-573607c29df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:22.803023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7651fb-0de4-49a4-9cbf-573607c29df0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.803420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7651fb-0de4-49a4-9cbf-573607c29df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.803705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7651fb-0de4-49a4-9cbf-573607c29df0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.804665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7651fb-0de4-49a4-9cbf-573607c29df0 None admin] RBAC: Adding query filter params (group.id=3ce7be0359614483b555ac166c9d3290, role.id=49ef71b3a9cd4f78998c8e7924bc1fac, scope.project.id=5c75dc25d4a74e258aebc6a53b585817) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:22.804984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7651fb-0de4-49a4-9cbf-573607c29df0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:22.806594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7651fb-0de4-49a4-9cbf-573607c29df0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:22.813730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 216/435] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:22 2022] GET /identity/v3/role_assignments?group.id=3ce7be0359614483b555ac166c9d3290&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=49ef71b3a9cd4f78998c8e7924bc1fac => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:22.819915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d5f4f-107b-4da8-9b96-8b5f94224218 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.820316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d5f4f-107b-4da8-9b96-8b5f94224218 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.820606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d5f4f-107b-4da8-9b96-8b5f94224218 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.822520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 217/436] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:22.830641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356c56-dc5c-4397-8808-24f23f54c47a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:22.830641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356c56-dc5c-4397-8808-24f23f54c47a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:22.830641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb356c56-dc5c-4397-8808-24f23f54c47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:22.851414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-fb356c56-dc5c-4397-8808-24f23f54c47a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:22.852718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fb356c56-dc5c-4397-8808-24f23f54c47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:22.872694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 220/437] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 16:59:22.881673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fc605-2448-45df-826f-7ac7aebca1df None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:22.939683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:22.950513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 218/438] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:22.979067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:22.985316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356c56-dc5c-4397-8808-24f23f54c47a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:23.079757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fc605-2448-45df-826f-7ac7aebca1df None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:23.119446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7db0-4726-4730-b906-6755e8aac4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:23.120330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7db0-4726-4730-b906-6755e8aac4ad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.120607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7db0-4726-4730-b906-6755e8aac4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.120877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7db0-4726-4730-b906-6755e8aac4ad None admin] PATH_INFO: `/v3/projects/a54cac18fe3448119899dcb53a77d938` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.122080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7db0-4726-4730-b906-6755e8aac4ad None admin] RBAC: Authorizing `identity:get_project(project_id=a54cac18fe3448119899dcb53a77d938)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:23.122897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb356c56-dc5c-4397-8808-24f23f54c47a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:23.123520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7db0-4726-4730-b906-6755e8aac4ad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:23.125586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 221/439] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:22 2022] GET /identity/v3/projects/a54cac18fe3448119899dcb53a77d938 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:23.130746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7db0-4726-4730-b906-6755e8aac4ad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:23.165437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd58e1-7c33-4a67-bec3-724b5f2a0154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:23.166459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd58e1-7c33-4a67-bec3-724b5f2a0154 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.167528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd58e1-7c33-4a67-bec3-724b5f2a0154 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.167814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd58e1-7c33-4a67-bec3-724b5f2a0154 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.179613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd58e1-7c33-4a67-bec3-724b5f2a0154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-9ebd58e1-7c33-4a67-bec3-724b5f2a0154 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:23.187689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:23.188873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:23.189744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 219/440] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:59:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:23.194840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd58e1-7c33-4a67-bec3-724b5f2a0154 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:23.249962 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7db0-4726-4730-b906-6755e8aac4ad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:23.262927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:23.265733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:23.291292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c870cd7-30e0-46ee-89f7-1b5952a48423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:23.292482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c870cd7-30e0-46ee-89f7-1b5952a48423 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.292482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c870cd7-30e0-46ee-89f7-1b5952a48423 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.292767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c870cd7-30e0-46ee-89f7-1b5952a48423 None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.293980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c870cd7-30e0-46ee-89f7-1b5952a48423 None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:23.295446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c870cd7-30e0-46ee-89f7-1b5952a48423 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:23.297374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 222/441] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:23 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:23.303718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c870cd7-30e0-46ee-89f7-1b5952a48423 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:23.319307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd58e1-7c33-4a67-bec3-724b5f2a0154 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:23.363575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:23.364249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.364530 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.365081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.365925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:23.366474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:23.367695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:23.376835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 220/442] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:23.382189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:23.431818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c870cd7-30e0-46ee-89f7-1b5952a48423 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:23.472042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b349-1b02-4038-8f55-f646ea45855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:23.472599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b349-1b02-4038-8f55-f646ea45855c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.472907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b349-1b02-4038-8f55-f646ea45855c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.473178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b349-1b02-4038-8f55-f646ea45855c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.474183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6b349-1b02-4038-8f55-f646ea45855c None admin] RBAC: Adding query filter params (group.id=3ce7be0359614483b555ac166c9d3290, role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=a54cac18fe3448119899dcb53a77d938) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:23.474593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6b349-1b02-4038-8f55-f646ea45855c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:23.476493 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6b349-1b02-4038-8f55-f646ea45855c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:23.482703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 223/443] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:23 2022] GET /identity/v3/role_assignments?group.id=3ce7be0359614483b555ac166c9d3290&scope.project.id=a54cac18fe3448119899dcb53a77d938&role.id=de3989d133584bab8378c170cee57ac6 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:23.504303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea8bc7-97cb-41ef-88e4-353a97ffdb9e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:23.524451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:23.545702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a59c-fa1b-4448-ae52-6da9fafab9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:23.546451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a59c-fa1b-4448-ae52-6da9fafab9dc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.546727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a59c-fa1b-4448-ae52-6da9fafab9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.547049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a59c-fa1b-4448-ae52-6da9fafab9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.559227 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4030c6-d0d8-4075-8a0f-dfa68b946acc None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.559564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4030c6-d0d8-4075-8a0f-dfa68b946acc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.559786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4030c6-d0d8-4075-8a0f-dfa68b946acc None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.561377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 224/444] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:23.567014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a3d4-357a-4b63-9ca7-a26528cb3d68 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.567298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a3d4-357a-4b63-9ca7-a26528cb3d68 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.567552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a3d4-357a-4b63-9ca7-a26528cb3d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.587119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6e11a3d4-357a-4b63-9ca7-a26528cb3d68 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:23.588358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6e11a3d4-357a-4b63-9ca7-a26528cb3d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:23.628435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:23.629299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893a59c-fa1b-4448-ae52-6da9fafab9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:23.630971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893a59c-fa1b-4448-ae52-6da9fafab9dc None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:23.668789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 225/445] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:23.694347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11a3d4-357a-4b63-9ca7-a26528cb3d68 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:23.755698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 221/446] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:23.761832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a59c-fa1b-4448-ae52-6da9fafab9dc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:23.783064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:23.808085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11a3d4-357a-4b63-9ca7-a26528cb3d68 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:23.853541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2f91b-0e04-487a-9972-86bee265ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:23.854415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f91b-0e04-487a-9972-86bee265ce32 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.854702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f91b-0e04-487a-9972-86bee265ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.854982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f91b-0e04-487a-9972-86bee265ce32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.868555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2f91b-0e04-487a-9972-86bee265ce32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-44b2f91b-0e04-487a-9972-86bee265ce32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:23.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:23.877406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:23.878282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:23.880963 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 226/447] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:23.884742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2f91b-0e04-487a-9972-86bee265ce32 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:23.893604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a59c-fa1b-4448-ae52-6da9fafab9dc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:23.921960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:23.932511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660f2c-762d-4242-a960-694482859b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:23.933407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660f2c-762d-4242-a960-694482859b3c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:23.933692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660f2c-762d-4242-a960-694482859b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:23.934078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660f2c-762d-4242-a960-694482859b3c None admin] PATH_INFO: `/v3/projects/5c75dc25d4a74e258aebc6a53b585817` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:23.935298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38660f2c-762d-4242-a960-694482859b3c None admin] RBAC: Authorizing `identity:get_project(project_id=5c75dc25d4a74e258aebc6a53b585817)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:23.936759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38660f2c-762d-4242-a960-694482859b3c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:23.938848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 222/448] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:23 2022] GET /identity/v3/projects/5c75dc25d4a74e258aebc6a53b585817 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:23.944590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660f2c-762d-4242-a960-694482859b3c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:24.011652 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2f91b-0e04-487a-9972-86bee265ce32 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:24.042112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:24.045712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:24.046429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:24.046703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:24.046978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:24.047745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:24.048053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:24.049463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:24.057891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660f2c-762d-4242-a960-694482859b3c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:24.058419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 227/449] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:24.064066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:24.092966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b401a7a-c647-4ef0-ab52-09e0df7642b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:24.093860 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401a7a-c647-4ef0-ab52-09e0df7642b7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:24.094142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401a7a-c647-4ef0-ab52-09e0df7642b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:24.094412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401a7a-c647-4ef0-ab52-09e0df7642b7 None admin] PATH_INFO: `/v3/groups/3ce7be0359614483b555ac166c9d3290` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:24.095625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b401a7a-c647-4ef0-ab52-09e0df7642b7 None admin] RBAC: Authorizing `identity:get_group(group_id=3ce7be0359614483b555ac166c9d3290)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:24.097069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b401a7a-c647-4ef0-ab52-09e0df7642b7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:24.098758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 223/450] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:23 2022] GET /identity/v3/groups/3ce7be0359614483b555ac166c9d3290 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:24.104972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b401a7a-c647-4ef0-ab52-09e0df7642b7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:24.158837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:24.165950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4bd55-1c88-4d40-bce4-18c453037575 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:24.198979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef241b-532c-467a-b206-782b5826ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:24.199622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef241b-532c-467a-b206-782b5826ba29 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:24.199888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef241b-532c-467a-b206-782b5826ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:24.200178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef241b-532c-467a-b206-782b5826ba29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:24.203959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b401a7a-c647-4ef0-ab52-09e0df7642b7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:24.238555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:24.239225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:24.239499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:24.239855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:24.240802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] RBAC: Adding query filter params (group.id=3ce7be0359614483b555ac166c9d3290, role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=5c75dc25d4a74e258aebc6a53b585817) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:24.241096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:24.242580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:24.248366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 224/451] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:24 2022] GET /identity/v3/role_assignments?group.id=3ce7be0359614483b555ac166c9d3290&scope.project.id=5c75dc25d4a74e258aebc6a53b585817&role.id=de3989d133584bab8378c170cee57ac6 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:24.268888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef241b-532c-467a-b206-782b5826ba29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:24.270327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef241b-532c-467a-b206-782b5826ba29 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:24.370862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:24.379611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 228/452] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 16:59:24.385613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:24.405557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:24.489233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293ce93-1f7e-46e6-b2c5-50fbc3d6772a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:24.525619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e31ac-7dda-401d-9bd8-06eac996ddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:24.526497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e31ac-7dda-401d-9bd8-06eac996ddf9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:24.526784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e31ac-7dda-401d-9bd8-06eac996ddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:24.527055 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e31ac-7dda-401d-9bd8-06eac996ddf9 None admin] PATH_INFO: `/v3/projects/817b32abe9534b1196adc7d371e17f3c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:24.528254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e31ac-7dda-401d-9bd8-06eac996ddf9 None admin] RBAC: Authorizing `identity:get_project(project_id=817b32abe9534b1196adc7d371e17f3c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:24.529713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e31ac-7dda-401d-9bd8-06eac996ddf9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:24.531467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 225/453] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 16:59:24 2022] GET /identity/v3/projects/817b32abe9534b1196adc7d371e17f3c => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:24.537205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef241b-532c-467a-b206-782b5826ba29 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:24.637699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef241b-532c-467a-b206-782b5826ba29 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:24.673008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282b8f-0d7f-4a79-811f-86e0678afc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:24.673901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282b8f-0d7f-4a79-811f-86e0678afc28 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:24.674179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282b8f-0d7f-4a79-811f-86e0678afc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:24.674404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282b8f-0d7f-4a79-811f-86e0678afc28 None admin] PATH_INFO: `/v3/groups/28a8562321054d4681442e4c238afff7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:24.675656 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42282b8f-0d7f-4a79-811f-86e0678afc28 None admin] RBAC: Authorizing `identity:get_group(group_id=28a8562321054d4681442e4c238afff7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:24.677303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42282b8f-0d7f-4a79-811f-86e0678afc28 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:24.678981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 229/454] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jun 23 16:59:24 2022] GET /identity/v3/groups/28a8562321054d4681442e4c238afff7 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:24.685034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e31ac-7dda-401d-9bd8-06eac996ddf9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:24.775721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:24.792807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e31ac-7dda-401d-9bd8-06eac996ddf9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:24.828590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf6ff6-a8c3-4afe-9d94-cec47a680d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:24.829245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6ff6-a8c3-4afe-9d94-cec47a680d86 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:24.829530 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6ff6-a8c3-4afe-9d94-cec47a680d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:24.829836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf6ff6-a8c3-4afe-9d94-cec47a680d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:24.830666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf6ff6-a8c3-4afe-9d94-cec47a680d86 None admin] RBAC: Adding query filter params (group.id=28a8562321054d4681442e4c238afff7, role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=817b32abe9534b1196adc7d371e17f3c) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:24.830976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf6ff6-a8c3-4afe-9d94-cec47a680d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:24.832425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf6ff6-a8c3-4afe-9d94-cec47a680d86 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:24.839002 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 226/455] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jun 23 16:59:24 2022] GET /identity/v3/role_assignments?group.id=28a8562321054d4681442e4c238afff7&scope.project.id=817b32abe9534b1196adc7d371e17f3c&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:27.318023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c23012-9684-4ffb-b8dc-2926358da883 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:27.319057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c23012-9684-4ffb-b8dc-2926358da883 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:27.319531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c23012-9684-4ffb-b8dc-2926358da883 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:27.321386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 230/456] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:27.327638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42e58-ef65-48c5-8a72-7e0a2c29a05a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:27.328547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42e58-ef65-48c5-8a72-7e0a2c29a05a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:27.329012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f42e58-ef65-48c5-8a72-7e0a2c29a05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:27.351142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a2f42e58-ef65-48c5-8a72-7e0a2c29a05a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:27.352703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a2f42e58-ef65-48c5-8a72-7e0a2c29a05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:27.460246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 227/457] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:27.505596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c23012-9684-4ffb-b8dc-2926358da883 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:27.595970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f28e-dda3-4f33-93f7-6873e4de1c24 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:27.596157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f28e-dda3-4f33-93f7-6873e4de1c24 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:27.596430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f28e-dda3-4f33-93f7-6873e4de1c24 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:27.598751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 228/458] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:27.602375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:27.605152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe04c4-7727-4c9b-bf23-e010f903ee05 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:27.605728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe04c4-7727-4c9b-bf23-e010f903ee05 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:27.606041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe04c4-7727-4c9b-bf23-e010f903ee05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:27.625277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f8fe04c4-7727-4c9b-bf23-e010f903ee05 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:27.626576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f8fe04c4-7727-4c9b-bf23-e010f903ee05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:27.666141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c23012-9684-4ffb-b8dc-2926358da883 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:27.715442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d162ca-0eb8-45ca-9b40-eec03308196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:27.716197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d162ca-0eb8-45ca-9b40-eec03308196f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:27.716474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d162ca-0eb8-45ca-9b40-eec03308196f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:27.716743 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d162ca-0eb8-45ca-9b40-eec03308196f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:27.731042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d162ca-0eb8-45ca-9b40-eec03308196f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:27.732540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d162ca-0eb8-45ca-9b40-eec03308196f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f7d162ca-0eb8-45ca-9b40-eec03308196f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:27.753527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:27.754482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:27.755449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:27.755449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:27.755449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:27.755449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:27.755449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 231/459] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:27.756231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39bde6-23c4-4484-860e-5bb3578f1cf3 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:27.756716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39bde6-23c4-4484-860e-5bb3578f1cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:27.756960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 229/460] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:27.757112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39bde6-23c4-4484-860e-5bb3578f1cf3 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:27.759885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 232/461] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:27.763387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe04c4-7727-4c9b-bf23-e010f903ee05 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:27.776124 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5831-03cc-4158-8974-6ab1bc5add72 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:27.776673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5831-03cc-4158-8974-6ab1bc5add72 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:27.777079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da5831-03cc-4158-8974-6ab1bc5add72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:27.778938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:27.797588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-52da5831-03cc-4158-8974-6ab1bc5add72 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:27.799181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-52da5831-03cc-4158-8974-6ab1bc5add72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:27.889846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 233/462] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:27.891174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da5831-03cc-4158-8974-6ab1bc5add72 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:27.900202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe04c4-7727-4c9b-bf23-e010f903ee05 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:27.943335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:27.944317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:27.944565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:27.944907 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:27.945711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:27.946107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:27.947600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:27.948091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:27.971036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 230/463] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:27.977155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:28.016660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da5831-03cc-4158-8974-6ab1bc5add72 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:28.055653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:28.056216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:28.057579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.058076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.058513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.071640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:28.073445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:28.093176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8378c4-ad46-440a-a8ee-2b5ae9171baf None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:28.093983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:28.094812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:28.095687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:28.095687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:28.095687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:28.095687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:28.097692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 234/464] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:28.098625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:28.134646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:28.135597 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.135860 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.136159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.147416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:28.148966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:28.168076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:28.169139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:28.170512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:28.170512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:28.170512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:28.170512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:28.170512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 231/465] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:28.170512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:28.209925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:28.216533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba2f6-57bd-44e1-b1ef-83d87cb21c05 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:28.257983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7f5bc-21d6-48db-9efe-d9f58d167f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:28.258900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f5bc-21d6-48db-9efe-d9f58d167f76 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.259194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f5bc-21d6-48db-9efe-d9f58d167f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.259470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f5bc-21d6-48db-9efe-d9f58d167f76 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.260324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7f5bc-21d6-48db-9efe-d9f58d167f76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:28.262083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7f5bc-21d6-48db-9efe-d9f58d167f76 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:28.276021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3f124-79ec-4667-a20d-b9e417c3557d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:28.290330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 235/466] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:59:28 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:28.290330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7f5bc-21d6-48db-9efe-d9f58d167f76 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:28.307593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:28.333405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3418bb-5483-4ca6-bef9-92e808c71628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:28.334250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3418bb-5483-4ca6-bef9-92e808c71628 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.334690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3418bb-5483-4ca6-bef9-92e808c71628 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.335043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3418bb-5483-4ca6-bef9-92e808c71628 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.336228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3418bb-5483-4ca6-bef9-92e808c71628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:28.337120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3418bb-5483-4ca6-bef9-92e808c71628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:28.339081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3418bb-5483-4ca6-bef9-92e808c71628 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:28.361855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 232/467] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:28.361855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a95f8-4718-4e9b-8317-119f176e744a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.361855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a95f8-4718-4e9b-8317-119f176e744a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.361855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a95f8-4718-4e9b-8317-119f176e744a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.361855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 233/468] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:28.366318 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a95f8-4718-4e9b-8317-119f176e744a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:28.440676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7f5bc-21d6-48db-9efe-d9f58d167f76 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:28.490617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426679d-1dca-45c9-8a84-01525560f221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:28.491723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426679d-1dca-45c9-8a84-01525560f221 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.492238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426679d-1dca-45c9-8a84-01525560f221 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.492543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426679d-1dca-45c9-8a84-01525560f221 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.493261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426679d-1dca-45c9-8a84-01525560f221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:28.493621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426679d-1dca-45c9-8a84-01525560f221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:28.495308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426679d-1dca-45c9-8a84-01525560f221 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:28.510702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 236/469] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:28.512026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d18460-c139-4874-80a8-e4d1116e7065 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.512315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d18460-c139-4874-80a8-e4d1116e7065 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.512588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d18460-c139-4874-80a8-e4d1116e7065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.513379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a95f8-4718-4e9b-8317-119f176e744a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:28.532709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-56d18460-c139-4874-80a8-e4d1116e7065 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:28.533930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-56d18460-c139-4874-80a8-e4d1116e7065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:28.541763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:28.558529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ae9b-abf3-4dd7-91be-544e84bed385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:28.559223 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ae9b-abf3-4dd7-91be-544e84bed385 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.559972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ae9b-abf3-4dd7-91be-544e84bed385 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.560288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ae9b-abf3-4dd7-91be-544e84bed385 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.561281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55ae9b-abf3-4dd7-91be-544e84bed385 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:28.562958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55ae9b-abf3-4dd7-91be-544e84bed385 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:28.590963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 234/470] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:59:28 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:28.597900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ae9b-abf3-4dd7-91be-544e84bed385 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:28.629529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 237/471] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:28.632928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:28.666862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d18460-c139-4874-80a8-e4d1116e7065 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:28.718851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ae9b-abf3-4dd7-91be-544e84bed385 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:28.798957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7673b-0861-4cd1-abc1-9d3aa01b7cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:28.799670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7673b-0861-4cd1-abc1-9d3aa01b7cb0 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.799951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7673b-0861-4cd1-abc1-9d3aa01b7cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.800227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7673b-0861-4cd1-abc1-9d3aa01b7cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.800952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7673b-0861-4cd1-abc1-9d3aa01b7cb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:28.802815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7673b-0861-4cd1-abc1-9d3aa01b7cb0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:28.844787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 235/472] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:59:28 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:28.858511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735d50c-f66b-45a6-a773-0b8a37a6ffa5 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.858802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735d50c-f66b-45a6-a773-0b8a37a6ffa5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.859085 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735d50c-f66b-45a6-a773-0b8a37a6ffa5 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.860603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 236/473] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:28.866568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a69bf-ff93-489e-9e32-7954937b6702 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.867191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a69bf-ff93-489e-9e32-7954937b6702 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.867764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a69bf-ff93-489e-9e32-7954937b6702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.886301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d18460-c139-4874-80a8-e4d1116e7065 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:28.893326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b41a69bf-ff93-489e-9e32-7954937b6702 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:28.895470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b41a69bf-ff93-489e-9e32-7954937b6702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:28.929629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:28.930651 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:28.930999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:28.931397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:28.945169 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:28.946955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:28.949485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:28.970475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:28.971359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:28.972209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:28.972209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:28.972209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:28.972209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:28.972209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 238/474] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:28.978380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:28.993567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 237/475] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:29.016057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a69bf-ff93-489e-9e32-7954937b6702 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:29.050922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:29.120121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f249137-d268-46be-a0f7-601e5da9cd37 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:29.144204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a69bf-ff93-489e-9e32-7954937b6702 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:29.164612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:29.165290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:29.165575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:29.165898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:29.166703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:29.167014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:29.169318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:29.186843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 239/476] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:29.190465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:29.191162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:29.191449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:29.192045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:29.192701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:29.193282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:29.194581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:29.209595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.sql.core [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 16:59:29.209595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 16:59:29.209595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [parameters: {'id': '09cd242ac03b4db9820d410f94c4463a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 16:59:29.209595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application conn.query(q) Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result.read() Jun 23 16:59:29.232408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 16:59:29.233543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application next(self.gen) Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application yield resource Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application next(self.gen) Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise self.value Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application session.commit() Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 16:59:29.234733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.session.flush() Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application compat.raise_( Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 16:59:29.235784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 16:59:29.236849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application conn.query(q) Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result.read() Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 16:59:29.242011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [parameters: {'id': '09cd242ac03b4db9820d410f94c4463a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:29.242996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 16:59:29.243837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:29.244651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 238/477] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 23 16:59:29 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:29.244651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:29.272504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:29.325502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae1460-e330-48ff-9daa-8fd46414afb9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:29.342112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:29.360245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a14bcc-4b82-434b-832a-8834c6d18389 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:29.366555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b4d0-5948-435f-b875-5bef7e7abac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:29.367571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b4d0-5948-435f-b875-5bef7e7abac7 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:29.368051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b4d0-5948-435f-b875-5bef7e7abac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:29.368619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b4d0-5948-435f-b875-5bef7e7abac7 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:29.369543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b4d0-5948-435f-b875-5bef7e7abac7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:29.371344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b4d0-5948-435f-b875-5bef7e7abac7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:29.397749 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 240/478] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:59:29 2022] POST /identity/v3/users => generated 249 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:29.405495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399afb71-42cb-4a7f-9fab-ca255d1c4a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:29.406415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399afb71-42cb-4a7f-9fab-ca255d1c4a50 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:29.406696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399afb71-42cb-4a7f-9fab-ca255d1c4a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:29.406968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399afb71-42cb-4a7f-9fab-ca255d1c4a50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:29.439028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399afb71-42cb-4a7f-9fab-ca255d1c4a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-399afb71-42cb-4a7f-9fab-ca255d1c4a50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:29.453700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:29.454727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:29.456012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 239/479] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 16:59:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:29.461272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b4d0-5948-435f-b875-5bef7e7abac7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:29.578520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b4d0-5948-435f-b875-5bef7e7abac7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:29.590815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:29.621279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756ad0-032b-4894-a66b-f01e14ff046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:29.621989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756ad0-032b-4894-a66b-f01e14ff046a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:29.622345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756ad0-032b-4894-a66b-f01e14ff046a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:29.622627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756ad0-032b-4894-a66b-f01e14ff046a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:29.623392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756ad0-032b-4894-a66b-f01e14ff046a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:29.623701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756ad0-032b-4894-a66b-f01e14ff046a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:29.625093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756ad0-032b-4894-a66b-f01e14ff046a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:29.634115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 241/480] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:30.943942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b6f0-86a4-45c0-9a32-4b0646897dda None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:30.944963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b6f0-86a4-45c0-9a32-4b0646897dda None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:30.945510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b6f0-86a4-45c0-9a32-4b0646897dda None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:30.947387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 240/481] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:30.952658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f45c14-0c05-4786-900f-43e270b986b0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:30.953443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f45c14-0c05-4786-900f-43e270b986b0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:30.953937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f45c14-0c05-4786-900f-43e270b986b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:30.975682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-17f45c14-0c05-4786-900f-43e270b986b0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:30.977210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-17f45c14-0c05-4786-900f-43e270b986b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:31.071697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 242/482] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:31.107983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7b6f0-86a4-45c0-9a32-4b0646897dda None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:31.221867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7b6f0-86a4-45c0-9a32-4b0646897dda None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:31.259668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d002c9-8071-443b-8deb-6f30111e690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:31.260487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d002c9-8071-443b-8deb-6f30111e690d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.260769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d002c9-8071-443b-8deb-6f30111e690d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.261044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d002c9-8071-443b-8deb-6f30111e690d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.272966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d002c9-8071-443b-8deb-6f30111e690d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-07d002c9-8071-443b-8deb-6f30111e690d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:31.280793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:31.281671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:31.282537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 241/483] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:31.290948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f45c14-0c05-4786-900f-43e270b986b0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:31.300031 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a4eb-29fc-4533-bb55-a309fbf3af72 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.300319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a4eb-29fc-4533-bb55-a309fbf3af72 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.300600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4a4eb-29fc-4533-bb55-a309fbf3af72 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.302484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 242/484] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:31.307891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61939e-2ce9-4d32-87bc-8d392d2841df None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.308178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61939e-2ce9-4d32-87bc-8d392d2841df None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.308454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61939e-2ce9-4d32-87bc-8d392d2841df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.321034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:31.327060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-bf61939e-2ce9-4d32-87bc-8d392d2841df None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:31.328667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bf61939e-2ce9-4d32-87bc-8d392d2841df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:31.405915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 243/485] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:31.407441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8963074-c0a1-450e-9e38-a0e71a48c133 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.407731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8963074-c0a1-450e-9e38-a0e71a48c133 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.408014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8963074-c0a1-450e-9e38-a0e71a48c133 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.409714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 244/486] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:31.415264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94182-a00b-49a0-9e10-294c1e0b48d0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.415556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94182-a00b-49a0-9e10-294c1e0b48d0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.415834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94182-a00b-49a0-9e10-294c1e0b48d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.436644 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f45c14-0c05-4786-900f-43e270b986b0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:31.438667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:31.448850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-32b94182-a00b-49a0-9e10-294c1e0b48d0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:31.450191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-32b94182-a00b-49a0-9e10-294c1e0b48d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:31.474280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:31.475331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.475612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.476147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.476952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:31.477542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:31.479654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:31.491756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 243/487] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:31.493002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:31.527322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 245/488] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:31.528333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b94182-a00b-49a0-9e10-294c1e0b48d0 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:31.617176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eae24-6e83-4095-97c4-565100559eaa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:31.624306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:31.654020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe11dd-91f0-4fde-8615-6ac0155c65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:31.654839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe11dd-91f0-4fde-8615-6ac0155c65a8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.655124 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe11dd-91f0-4fde-8615-6ac0155c65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.655394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe11dd-91f0-4fde-8615-6ac0155c65a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.666188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe11dd-91f0-4fde-8615-6ac0155c65a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:31.667185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b94182-a00b-49a0-9e10-294c1e0b48d0 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-65fe11dd-91f0-4fde-8615-6ac0155c65a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:31.674052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:31.674965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:31.675771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:31.680403 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 244/489] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:31.681294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe11dd-91f0-4fde-8615-6ac0155c65a8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:31.705309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:31.706150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.706428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.706700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.708788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:31.719050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:31.720527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:31.741272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:31.742396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:31.743279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:31.743279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:31.743279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:31.743279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:31.743279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 246/490] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:31.743544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:31.787047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe11dd-91f0-4fde-8615-6ac0155c65a8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:31.821971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b646-b8f9-430c-abe1-5af90f9aae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:31.822787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b646-b8f9-430c-abe1-5af90f9aae17 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.823081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b646-b8f9-430c-abe1-5af90f9aae17 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.823365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b646-b8f9-430c-abe1-5af90f9aae17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.834432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b646-b8f9-430c-abe1-5af90f9aae17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-72f5b646-b8f9-430c-abe1-5af90f9aae17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:31.842319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:31.844185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 245/491] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:31.846131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b646-b8f9-430c-abe1-5af90f9aae17 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:31.857334 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71731c2-689a-4625-89e6-d1fb4c32ee33 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:31.876127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:31.895716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:31.896470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:31.896890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:31.897194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:31.898091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] RBAC: Adding query filter params (name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:31.898396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:31.899865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:31.908850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 247/492] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:31.909685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:31.949679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:31.968121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b646-b8f9-430c-abe1-5af90f9aae17 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.006635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.007223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.007507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.007788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.008638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:32.009047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.010619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.024094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a206-56d5-4c11-b15e-70967895e930 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.024701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 246/493] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:32.025196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.059878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.060552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.060831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.061195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.062060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] RBAC: Adding query filter params (name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:32.062370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.063745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.072588 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 248/494] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:32.073243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.123584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:32.132237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915f86-1521-42d8-83de-03445d0f52a3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.166616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.167433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.167715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.167992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.178508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.179976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.182972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:32.186243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f4729-1693-480f-b856-617ec5e95617 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:32.199465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:32.200375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:32.201251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:32.201251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:32.201251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:32.201251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:32.201251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 247/495] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:32.201525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.229133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd802d-4f39-47f5-ab97-9a613193af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.230286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd802d-4f39-47f5-ab97-9a613193af37 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.230722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd802d-4f39-47f5-ab97-9a613193af37 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.230985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd802d-4f39-47f5-ab97-9a613193af37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.238766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd802d-4f39-47f5-ab97-9a613193af37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.240335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd802d-4f39-47f5-ab97-9a613193af37 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-5fdd802d-4f39-47f5-ab97-9a613193af37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:32.256294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:32.257466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 249/496] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:32.258787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd4d1-637b-4204-a9eb-5c4ffa985240 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.259748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd4d1-637b-4204-a9eb-5c4ffa985240 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.259748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd4d1-637b-4204-a9eb-5c4ffa985240 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.260806 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 250/497] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:32.263073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cd4d1-637b-4204-a9eb-5c4ffa985240 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.314986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2497990-eb64-48ed-9f27-21d9e65bd76c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.351681 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3530d3-9d26-4180-b962-ea9f7c576084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.352499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3530d3-9d26-4180-b962-ea9f7c576084 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.352787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3530d3-9d26-4180-b962-ea9f7c576084 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.353066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3530d3-9d26-4180-b962-ea9f7c576084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.363412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3530d3-9d26-4180-b962-ea9f7c576084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.365476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3530d3-9d26-4180-b962-ea9f7c576084 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.369511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cd4d1-637b-4204-a9eb-5c4ffa985240 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.371069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8d3530d3-9d26-4180-b962-ea9f7c576084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:32.382948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:32.383853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:32.384715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:32.384715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:32.384715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:32.384715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:32.384715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 248/498] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:32.385342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801de36-859e-484d-b343-138f73be81d0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.385674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801de36-859e-484d-b343-138f73be81d0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.385951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801de36-859e-484d-b343-138f73be81d0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.387250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 249/499] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:32.388027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801de36-859e-484d-b343-138f73be81d0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.410544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a69655-c285-42cf-9464-416b6d9f53e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.411229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69655-c285-42cf-9464-416b6d9f53e7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.411513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69655-c285-42cf-9464-416b6d9f53e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.411785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69655-c285-42cf-9464-416b6d9f53e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.412509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a69655-c285-42cf-9464-416b6d9f53e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:32.412816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a69655-c285-42cf-9464-416b6d9f53e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.414243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a69655-c285-42cf-9464-416b6d9f53e7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.425595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 251/500] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:32.427030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37db578-c586-4ea5-9fc0-eb077507d6ea None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.427392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37db578-c586-4ea5-9fc0-eb077507d6ea None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.427665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37db578-c586-4ea5-9fc0-eb077507d6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.441327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:32.444485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a37db578-c586-4ea5-9fc0-eb077507d6ea None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:32.445693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a37db578-c586-4ea5-9fc0-eb077507d6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:32.494445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801de36-859e-484d-b343-138f73be81d0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.511197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 252/501] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:32.511957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37db578-c586-4ea5-9fc0-eb077507d6ea None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.544995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420abf43-098c-418c-8123-400057c5fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.545673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420abf43-098c-418c-8123-400057c5fa88 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.545977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420abf43-098c-418c-8123-400057c5fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.546251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420abf43-098c-418c-8123-400057c5fa88 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.547127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420abf43-098c-418c-8123-400057c5fa88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:32.547430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420abf43-098c-418c-8123-400057c5fa88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.548867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420abf43-098c-418c-8123-400057c5fa88 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.587791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 250/502] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:32.592391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588b61-333f-4724-aa03-c7e6e631423f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.592391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588b61-333f-4724-aa03-c7e6e631423f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.592391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588b61-333f-4724-aa03-c7e6e631423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.606756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1e588b61-333f-4724-aa03-c7e6e631423f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:32.608457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1e588b61-333f-4724-aa03-c7e6e631423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:32.609996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:32.619991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37db578-c586-4ea5-9fc0-eb077507d6ea None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.664900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.665568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.665859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.666134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.666863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:32.667160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.668550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.679996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 253/503] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:32.680890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.692519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 251/504] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:32.693425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e588b61-333f-4724-aa03-c7e6e631423f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.729356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:32.792555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e588b61-333f-4724-aa03-c7e6e631423f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.794272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a36f74-e8b4-4738-a67d-7f16292d199e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.827782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.827949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:32.828574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.828692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:32.828852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.828947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:32.829122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.829211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:32.837630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.839110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.840230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:32.841703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:32.853420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:32.854412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:32.855344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 254/505] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:32.855913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:32.859911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:32.860776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:32.862742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:32.862742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:32.862742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:32.862742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:32.862742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 252/506] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:32.862742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:32.874118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:32.950083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:32.968123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bca16-3579-4fa7-9f0b-700e68c9e36a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:32.968899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276e51-82af-409e-9cc0-aec25874c7a9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.002437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.002804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895ed13-947e-4f25-bd6a-028fd5c2fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.003239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.003455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895ed13-947e-4f25-bd6a-028fd5c2fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.003549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.003740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895ed13-947e-4f25-bd6a-028fd5c2fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.003827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.004018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895ed13-947e-4f25-bd6a-028fd5c2fcf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.011591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.013057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:33.028470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:33.029381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 253/507] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:33.030763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.078481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895ed13-947e-4f25-bd6a-028fd5c2fcf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.079963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895ed13-947e-4f25-bd6a-028fd5c2fcf5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.093213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:33.133267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3023715-3729-4595-8c67-8dc010741509 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.167500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2853e5-2f65-4472-9d66-de6450da211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.168321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2853e5-2f65-4472-9d66-de6450da211c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.168604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2853e5-2f65-4472-9d66-de6450da211c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.168879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2853e5-2f65-4472-9d66-de6450da211c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.176320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 255/508] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:33.177197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895ed13-947e-4f25-bd6a-028fd5c2fcf5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.179474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2853e5-2f65-4472-9d66-de6450da211c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4c2853e5-2f65-4472-9d66-de6450da211c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:33.187566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:33.188470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:33.189268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 254/509] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:33.189993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2853e5-2f65-4472-9d66-de6450da211c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.204859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:33.278191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895ed13-947e-4f25-bd6a-028fd5c2fcf5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.292360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:33.296346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2853e5-2f65-4472-9d66-de6450da211c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.314309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.314986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.315267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.315541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.316379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:33.316686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.318156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.332192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.332792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.333175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.333501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.334271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:33.334577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.335956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.347755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 255/510] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:33.348549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.354898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 256/511] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 23 16:59:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:33.355772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.417408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:33.450895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc2010-7950-43ff-a686-330e9a445b7d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.454668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d1ac9-a8e1-4aa9-81f2-587dd470e501 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.484915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.485583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.485908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.486204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.487043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:33.487350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.488864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.488988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.489782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.490080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.490339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.500284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.501725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.505864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 256/512] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 23 16:59:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:33.506551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:33.521504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:33.522434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:33.523292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:33.523292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:33.523292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:33.523292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:33.523292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 257/513] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:33.523585 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.549257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:33.611199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504a213-915a-4024-864b-40ebd71bd90e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.628070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461c5d6-1199-48ed-a766-ff8afd0974c1 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.637374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:33.646857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.647522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.647865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.648142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.648905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:33.649192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.650601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.658380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 257/514] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:33.659184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.661263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3fff-d582-4eaa-be8a-49957e7cc910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.661960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3fff-d582-4eaa-be8a-49957e7cc910 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.662233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3fff-d582-4eaa-be8a-49957e7cc910 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.662505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3fff-d582-4eaa-be8a-49957e7cc910 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.663341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a3fff-d582-4eaa-be8a-49957e7cc910 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.664787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a3fff-d582-4eaa-be8a-49957e7cc910 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.685598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 258/515] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:59:33 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:33.686384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3fff-d582-4eaa-be8a-49957e7cc910 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:33.777712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:33.785910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77a0ef-4574-4c2c-865f-d9907f436d75 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.810696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3fff-d582-4eaa-be8a-49957e7cc910 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:33.823742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd1e5b-a729-4348-a537-ec1386443b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.824404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd1e5b-a729-4348-a537-ec1386443b90 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.824689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd1e5b-a729-4348-a537-ec1386443b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.824959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd1e5b-a729-4348-a537-ec1386443b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.855559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2798f-d539-4b02-9b1c-e7848caab2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:33.856222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2798f-d539-4b02-9b1c-e7848caab2fe None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:33.856514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2798f-d539-4b02-9b1c-e7848caab2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:33.856790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2798f-d539-4b02-9b1c-e7848caab2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:33.892744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:33.907766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd1e5b-a729-4348-a537-ec1386443b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.909232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd1e5b-a729-4348-a537-ec1386443b90 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:33.934634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2798f-d539-4b02-9b1c-e7848caab2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:33.936560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2798f-d539-4b02-9b1c-e7848caab2fe None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.016045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:34.033781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 258/516] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:34.033781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd1e5b-a729-4348-a537-ec1386443b90 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.049256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 259/517] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:34.049256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2798f-d539-4b02-9b1c-e7848caab2fe None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.130248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:34.143938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd1e5b-a729-4348-a537-ec1386443b90 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.152469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2798f-d539-4b02-9b1c-e7848caab2fe None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.184126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.184798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.185074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.185346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.186163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:34.186470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.187867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.190351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.191163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.191445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.191716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.204315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 259/518] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:34.204315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.207395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.209036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:34.228177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:34.229109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:34.229992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:34.229992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:34.229992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:34.229992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:34.229992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 260/519] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:34.230868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.266535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:34.315009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2e1a-752e-4b30-840b-ce958139603e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.349301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8875e0-4f78-449f-924c-6b52d1ca442c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.349527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.350345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.350627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.350901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.361869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.363340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.371958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:34.381643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:34.382657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:34.383629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:34.383629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:34.383629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:34.383629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:34.388116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 260/520] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:34.389024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.394638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.395423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.395739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.396004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.407910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.409393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:34.428719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:34.429612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:34.430786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:34.430786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:34.430786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:34.430786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:34.430786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 261/521] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:34.430786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.502581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07e0f-c68f-4b6d-807e-0813bcbef89a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.524474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:34.538064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.538874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.539162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.539442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.546206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.546941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6c33-3073-4245-8022-86f347f25fe8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.547662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:34.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:34.564689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:34.565550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:34.565550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:34.565550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:34.565550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:34.565550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:34.565550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:34.565550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:34.565550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:34.567436 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 261/522] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:34.568360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.587966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.588658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.588944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.589219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.589980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:34.590492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.591700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.609457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 262/523] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:34.609457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.629815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:34.677139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142d9a-928d-4fe2-9f4d-aad5470dd285 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.714937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.715590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.715874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.716173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.716896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:34.717205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.718619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.730674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 262/524] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:34.731477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.740024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c10fd-f7f5-4569-a9de-09683becd1c4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.776320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.777003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.777316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.777786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.778565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:34.778891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.780277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.792570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 263/525] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:34.793389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.796202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:34.843092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9c805-7cbe-417d-a234-19a3e6422daf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.865478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:34.881816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.882527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.882785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.883063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.883931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:34.884171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.885610 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.899967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dd745-b955-4d1d-9ac2-d6b644546485 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:34.908589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 263/526] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:34.908589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:34.936789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:34.937605 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:34.937920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:34.938197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:34.946642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:34.948094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:34.967051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:34.968027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 16:59:34.968924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:34.976262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 264/527] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:34.976262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.022783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5e71-7960-4059-a0e1-a4ad46116ca1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.035358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:35.058305 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.059103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.059384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.059654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.066503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.068043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.076456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641939f-5bad-4b5f-bfee-cce77ef03895 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:35.082372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:35.083244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:35.084104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 264/528] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:35.084997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.118499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.119315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.119616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.119875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.127644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.129168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.129780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:35.144416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:35.145341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 265/529] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:35.146417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.197358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ec53a-9c13-44d3-a3e4-2cb01d0a3838 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.233145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.234140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.234630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.234975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.235816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=10b3274005534830b0768b122769dd1a) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:35.236129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.237580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.243261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 265/530] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:35 2022] GET /identity/v3/role_assignments?user.id=10b3274005534830b0768b122769dd1a&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:35.250142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18eab4-7e23-41d9-ad4a-0189055df313 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.252006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.283415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:35.301955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.303829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.304373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.304843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.306540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:35.307496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.309590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.337715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 266/531] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 23 16:59:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:35.339816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.377332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace953da-e266-4da8-ad1e-1d48038dc2b5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.381072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:35.425151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.425913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.426141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.426416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.427301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:35.427611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.429062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.443395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 266/532] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:35.444248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.487128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8353248-52d1-41d0-bbfe-f56e16196e55 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.524293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.524755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.525040 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.525321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.526141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:35.526452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.527912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.550171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 267/533] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:35.551130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.565252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3d0c2-ef72-4db6-8fb0-77b256b535b9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.602486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e28427-7d95-4e00-ae31-d45a2f2e5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.603150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e28427-7d95-4e00-ae31-d45a2f2e5703 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.603475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e28427-7d95-4e00-ae31-d45a2f2e5703 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.603760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e28427-7d95-4e00-ae31-d45a2f2e5703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.608640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:35.639900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:35.682764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e28427-7d95-4e00-ae31-d45a2f2e5703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.684414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e28427-7d95-4e00-ae31-d45a2f2e5703 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.689535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac59ee8-e939-4bd9-ba0f-6c342c0c80ec None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.733952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.734789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.735263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.735635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.736677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=3c8b0c3534b84db68461b426a3f78773) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:35.737083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.738712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.750170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 268/534] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:35 2022] GET /identity/v3/role_assignments?user.id=3c8b0c3534b84db68461b426a3f78773&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:35.751212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.834081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 267/535] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:35.836151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5158d-0c44-4275-afd5-d062eab9f073 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.836446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5158d-0c44-4275-afd5-d062eab9f073 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.836727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5158d-0c44-4275-afd5-d062eab9f073 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.839122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 268/536] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:35.844142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5158d-0c44-4275-afd5-d062eab9f073 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:35.878130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9aca8-9909-4a82-a716-18bbe5d302f1 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:35.881272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:35.916308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:35.924850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d483525-fdfb-4ba4-9cce-03177f1e5f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:35.925520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d483525-fdfb-4ba4-9cce-03177f1e5f5e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.925850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d483525-fdfb-4ba4-9cce-03177f1e5f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.926107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d483525-fdfb-4ba4-9cce-03177f1e5f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.927054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d483525-fdfb-4ba4-9cce-03177f1e5f5e None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=9c211cd37d7f49eaa916d332580135c9) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:35.927366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d483525-fdfb-4ba4-9cce-03177f1e5f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:35.928820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d483525-fdfb-4ba4-9cce-03177f1e5f5e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:35.936652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 269/537] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:35 2022] GET /identity/v3/role_assignments?user.id=9c211cd37d7f49eaa916d332580135c9&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:35.938315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5ee44-e7b9-41da-bb57-d02569cdba7a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:35.938767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5ee44-e7b9-41da-bb57-d02569cdba7a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:35.939222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5ee44-e7b9-41da-bb57-d02569cdba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:35.967579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e6d5ee44-e7b9-41da-bb57-d02569cdba7a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:35.970555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e6d5ee44-e7b9-41da-bb57-d02569cdba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:35.995477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5158d-0c44-4275-afd5-d062eab9f073 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:36.060727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:36.063420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:36.064996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:36.065468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:36.093093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:36.096135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:36.119712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:36.120621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:36.121554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:36.121554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:36.121554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:36.121554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:36.124169 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 269/538] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:36.131157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:36.138976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 270/539] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:36.174337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5ee44-e7b9-41da-bb57-d02569cdba7a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:36.244884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448538ec-e614-4786-81fc-1c706229c4ea None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:36.264706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:36.292246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:36.292919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:36.293207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:36.293483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:36.294249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:36.294558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:36.295957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:36.320531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 270/540] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:36.325996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:36.388523 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:36.397085 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5ee44-e7b9-41da-bb57-d02569cdba7a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:36.474846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e075156-8878-450c-ac90-aa4889d5688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:36.475665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e075156-8878-450c-ac90-aa4889d5688b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:36.475945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e075156-8878-450c-ac90-aa4889d5688b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:36.476216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e075156-8878-450c-ac90-aa4889d5688b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:36.496471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e075156-8878-450c-ac90-aa4889d5688b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:36.511216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4985e-cff4-4d4c-99f2-caf753e8666d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-1e075156-8878-450c-ac90-aa4889d5688b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:36.512941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:36.513820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:36.514625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:36.516375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 271/541] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:36.520569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e075156-8878-450c-ac90-aa4889d5688b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:36.577590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:36.579717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:36.580004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:36.580280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:36.594326 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:36.596181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:36.629859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:36.630774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:36.631623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:36.631623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:36.631623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:36.631623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:36.631623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:36.631623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:36.631623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:36.631623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:36.634231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 271/542] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:36.639361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:36.659606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e075156-8878-450c-ac90-aa4889d5688b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:36.704245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:36.704933 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:36.705214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:36.705491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:36.706333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] RBAC: Adding query filter params (name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:36.706645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:36.708182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:36.717191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 272/543] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:36.717671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:36.722445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:36.771414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:36.832012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e025c-d228-4d7f-a605-f7e392f287b8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:36.876171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:36.876889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:36.877176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:36.877453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:36.878286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:36.878597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:36.880068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:36.910539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 272/544] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:36.914869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:36.940577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4eac4-def9-48b5-9095-bb5aa69cb801 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:36.985944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:36.987326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:36.988556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:36.990207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:37.013147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:37.016610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:37.050595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:37.051522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:37.052586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:37.052586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:37.052586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:37.052586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:37.057645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 273/545] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:37.065007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:37.134836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:37.141329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e287c-8f4d-4072-ab14-481c91e09aee None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:37.146461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:37.181084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551a69-d3e5-4fc1-a892-a608f2f6eada None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:37.209288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:37.210004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:37.210310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:37.210733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:37.211423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=2a92136d53514159a22faacb60ef0c50) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:37.211791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:37.213178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:37.219063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:37.219955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:37.220423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:37.220917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:37.221846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:37.222341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:37.224050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:37.229677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 273/546] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:36 2022] GET /identity/v3/role_assignments?user.id=2a92136d53514159a22faacb60ef0c50&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:37.237383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 274/547] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:37.243290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:37.399314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7cc58-e10c-4856-9eac-05891341e730 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:37.446982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da648a77-b905-400c-bae8-0162b60689c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:37.447795 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648a77-b905-400c-bae8-0162b60689c2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:37.448192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648a77-b905-400c-bae8-0162b60689c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:37.448477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648a77-b905-400c-bae8-0162b60689c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:37.457146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da648a77-b905-400c-bae8-0162b60689c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:37.458806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da648a77-b905-400c-bae8-0162b60689c2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-da648a77-b905-400c-bae8-0162b60689c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:37.473038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:37.474370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:37.476398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 274/548] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:37.480097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:37.623804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eeba90-d930-4a59-a2f8-b3e01761ac39 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:37.644998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a0e7-c137-42cd-bbb8-153fc1bcf5a2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:37.645310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a0e7-c137-42cd-bbb8-153fc1bcf5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:37.645627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a0e7-c137-42cd-bbb8-153fc1bcf5a2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:37.647269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 275/549] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:37.652522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26c50-910f-47a1-9320-a06f801949f7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:37.652744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26c50-910f-47a1-9320-a06f801949f7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:37.653027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26c50-910f-47a1-9320-a06f801949f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:37.663477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:37.668297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:37.669094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:37.669776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:37.670980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:37.671839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:37.672146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:37.673594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:37.693870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6fb26c50-910f-47a1-9320-a06f801949f7 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:37.695109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6fb26c50-910f-47a1-9320-a06f801949f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:37.712846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 275/550] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 23 16:59:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:37.718372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:37.732154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:37.826483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 276/551] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:37.866711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26c50-910f-47a1-9320-a06f801949f7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:37.899772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab770c0-b1ea-430a-a5b7-06a0f6434f4c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:37.962756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96c893-67c2-4005-80f7-f1ca5d5a3dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:37.963332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96c893-67c2-4005-80f7-f1ca5d5a3dab None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:37.963613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96c893-67c2-4005-80f7-f1ca5d5a3dab None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:37.963895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96c893-67c2-4005-80f7-f1ca5d5a3dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.044848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26c50-910f-47a1-9320-a06f801949f7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:38.063193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:38.080006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96c893-67c2-4005-80f7-f1ca5d5a3dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:38.081494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96c893-67c2-4005-80f7-f1ca5d5a3dab None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:38.113863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0816954-1cdc-403d-b00e-283812b052da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:38.114797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0816954-1cdc-403d-b00e-283812b052da None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.115079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0816954-1cdc-403d-b00e-283812b052da None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.115349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0816954-1cdc-403d-b00e-283812b052da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.134020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0816954-1cdc-403d-b00e-283812b052da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a0816954-1cdc-403d-b00e-283812b052da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:38.141817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:38.143508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:38.144657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 277/552] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:38.148896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0816954-1cdc-403d-b00e-283812b052da None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.162404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:38.227338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 276/553] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:38.229063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdfa19-6fea-429d-94cb-d5ef6e89867f None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.229580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdfa19-6fea-429d-94cb-d5ef6e89867f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.230074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdfa19-6fea-429d-94cb-d5ef6e89867f None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.231989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 277/554] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:38.233331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753c1b-c036-47ee-b858-e00ba93b4b95 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.233645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753c1b-c036-47ee-b858-e00ba93b4b95 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.233994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753c1b-c036-47ee-b858-e00ba93b4b95 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.235352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 278/555] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:38.238895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd753c1b-c036-47ee-b858-e00ba93b4b95 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.262995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0816954-1cdc-403d-b00e-283812b052da None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:38.298215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51f97-21d5-4697-9228-06ab6f883e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:38.298899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51f97-21d5-4697-9228-06ab6f883e07 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.299176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51f97-21d5-4697-9228-06ab6f883e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.299449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51f97-21d5-4697-9228-06ab6f883e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.300198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51f97-21d5-4697-9228-06ab6f883e07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:38.300499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51f97-21d5-4697-9228-06ab6f883e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:38.302047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51f97-21d5-4697-9228-06ab6f883e07 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:38.312365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 278/556] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:38.313707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e94a6-298c-4c35-a3ef-a3c7cd5550dd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.314495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e94a6-298c-4c35-a3ef-a3c7cd5550dd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.314952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e94a6-298c-4c35-a3ef-a3c7cd5550dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.332441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-913e94a6-298c-4c35-a3ef-a3c7cd5550dd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:38.333829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-913e94a6-298c-4c35-a3ef-a3c7cd5550dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:38.340758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:38.352646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd753c1b-c036-47ee-b858-e00ba93b4b95 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:38.389195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:38.390026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.390720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.390992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.402183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:38.403764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:38.409884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 279/557] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:38.409884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41118-8149-446f-9ed0-55e23ed0c39f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.409884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41118-8149-446f-9ed0-55e23ed0c39f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.409884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41118-8149-446f-9ed0-55e23ed0c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.414131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:38.429260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:38.430279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:38.431159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:38.431159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:38.431159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:38.431159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:38.434041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:38.435353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.436979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f1b41118-8149-446f-9ed0-55e23ed0c39f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:38.438327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f1b41118-8149-446f-9ed0-55e23ed0c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:38.508492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 280/559] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:38.519149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b41118-8149-446f-9ed0-55e23ed0c39f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.543097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77430852-4363-4b59-8cae-13a9d3d2b326 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:38.579370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:38.580222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.580498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.580803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.592717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:38.594208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:38.596050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:38.614509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:38.615931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:38.616825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:38.616825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:38.616825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:38.616825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:38.616825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:38.616825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.627106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b41118-8149-446f-9ed0-55e23ed0c39f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:38.664226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:38.671176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930683b-150c-432f-ac06-732bf7da6e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:38.672547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930683b-150c-432f-ac06-732bf7da6e6b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.672967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930683b-150c-432f-ac06-732bf7da6e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.673424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930683b-150c-432f-ac06-732bf7da6e6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.685428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930683b-150c-432f-ac06-732bf7da6e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a930683b-150c-432f-ac06-732bf7da6e6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:38.693726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:38.694684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:38.695612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 281/561] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:38.696320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930683b-150c-432f-ac06-732bf7da6e6b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.731621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b180ae-b70a-4f5e-99cf-fc73add4f1da None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:38.765873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:38.766475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.766756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.767028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.767746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:38.768048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:38.769429 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:38.781459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:38.783580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.807255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930683b-150c-432f-ac06-732bf7da6e6b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:38.844961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:38.849236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8f54e-8375-4468-9704-feb1e0d22e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:38.850083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f54e-8375-4468-9704-feb1e0d22e4f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.850466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f54e-8375-4468-9704-feb1e0d22e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.850659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f54e-8375-4468-9704-feb1e0d22e4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.861408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8f54e-8375-4468-9704-feb1e0d22e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ede8f54e-8375-4468-9704-feb1e0d22e4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:38.869295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:38.870373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:38.871275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:38.875571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:38.876683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8f54e-8375-4468-9704-feb1e0d22e4f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.896041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df6e3-289a-4155-8260-90afff30e156 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:38.931732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:38.932233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:38.932408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:38.932672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:38.932945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:38.933720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:38.934062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:38.935565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:38.952496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:38.952496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:38.986867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8f54e-8375-4468-9704-feb1e0d22e4f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.025433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.026160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.026501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.026786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.027543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:39.027851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.029328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.042841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 283/565] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:39.042841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.068271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6da865-8599-4bdd-9292-5843de82456c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.083920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:39.107962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.109169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.109656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.110100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.117530 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.119267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:39.134681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:39.135768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:39.136848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:39.136848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:39.136848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:39.136848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:39.136848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:39.136848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:39.136848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:39.136848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:39.143159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e96a-a06e-4cb6-97e4-ddbebef21408 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.143763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:39.144706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.156957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:39.182518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.183194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.183533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.183811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.184585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:39.184893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.186308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.194753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:39.195553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.251469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cb9d2-d230-4d37-91a1-c9ca792b8f07 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.286249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.287281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.287722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.288165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.295944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.297555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.309862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f476-c711-4bb4-87fd-109763516f1a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:39.312560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:39.313514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:39.314494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 284/568] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:39.315087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.349434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2495c-475e-449f-8439-53651063e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.350563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2495c-475e-449f-8439-53651063e870 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.350843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2495c-475e-449f-8439-53651063e870 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.351115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2495c-475e-449f-8439-53651063e870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.351785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:39.362587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2495c-475e-449f-8439-53651063e870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.364046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2495c-475e-449f-8439-53651063e870 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-23b2495c-475e-449f-8439-53651063e870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:39.381572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:39.382523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:39.383417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:39.383417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:39.383417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:39.383417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:39.383417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 285/569] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:39.383698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2495c-475e-449f-8439-53651063e870 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.412481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:39.420874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd6c5d-da10-4de4-b30c-de401b9c992c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.457232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.457926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.458784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.459073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.459866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:39.460179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.461640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.473249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 285/570] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:39.474158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.486472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2495c-475e-449f-8439-53651063e870 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.520335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99433ee6-45d4-491e-a979-eb85502afadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.521136 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99433ee6-45d4-491e-a979-eb85502afadc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.521416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99433ee6-45d4-491e-a979-eb85502afadc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.521769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99433ee6-45d4-491e-a979-eb85502afadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.532640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99433ee6-45d4-491e-a979-eb85502afadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.534133 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99433ee6-45d4-491e-a979-eb85502afadc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-99433ee6-45d4-491e-a979-eb85502afadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:39.550851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:39.551913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:39.552815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:39.552815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:39.552815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:39.552815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:39.552815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 286/571] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:39.553464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a973-d2de-4ed6-98b6-e20ba88c72c6 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.553657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a973-d2de-4ed6-98b6-e20ba88c72c6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.553953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a973-d2de-4ed6-98b6-e20ba88c72c6 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.555189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 287/572] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:39.555863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0a973-d2de-4ed6-98b6-e20ba88c72c6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.573236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:39.580842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1b4bf-76d8-40c4-a058-578457a6e9c9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.614160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.614966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.615317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.615663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.616574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:39.616955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.618491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.635907 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 286/573] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:39.636716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.641120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:39.661440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0a973-d2de-4ed6-98b6-e20ba88c72c6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.700350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.701019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.701297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.701544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.702661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:39.702960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.704333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.716805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 288/574] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:39.717608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.739648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101997de-1f1e-4f98-81a6-6c47f4b78d58 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.774354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894f213-baf6-46c1-b425-76272e0e263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.775008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894f213-baf6-46c1-b425-76272e0e263a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.775289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894f213-baf6-46c1-b425-76272e0e263a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.775569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894f213-baf6-46c1-b425-76272e0e263a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.776403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894f213-baf6-46c1-b425-76272e0e263a None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=08ffc7cdb0d54083bbedaa3e7441e099) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:39.776714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894f213-baf6-46c1-b425-76272e0e263a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.778195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894f213-baf6-46c1-b425-76272e0e263a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.784070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 287/575] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/role_assignments?user.id=08ffc7cdb0d54083bbedaa3e7441e099&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:39.785234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6041-70cb-4e02-8ee4-0c7de42e5d3c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.785518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6041-70cb-4e02-8ee4-0c7de42e5d3c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.785816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6041-70cb-4e02-8ee4-0c7de42e5d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.809959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d0df6041-70cb-4e02-8ee4-0c7de42e5d3c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:39.811133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d0df6041-70cb-4e02-8ee4-0c7de42e5d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:39.823756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:39.834467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4ecf6-2abd-47d3-8103-ad66903fa9be None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:39.877016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:39.877824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:39.878110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:39.878381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:39.879120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:39.879535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:39.881250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:39.885059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 288/576] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:39.885706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df6041-70cb-4e02-8ee4-0c7de42e5d3c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:39.901830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:39.904267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 289/577] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:39.905218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.002616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df6041-70cb-4e02-8ee4-0c7de42e5d3c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.014187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfde239-97bf-441e-b641-b114b61b72c4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.040468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.042229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.042505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.042801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.050571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.051836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.052280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.052565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] PATH_INFO: `/v3/users/glance` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.053147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.054858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.060407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.061770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.062858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:40.074991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:40.075906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:40.076797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:40.076797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:40.076797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:40.076797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:40.078088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:40.079012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:40.079970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 290/579] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:40.080564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.081217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 289/579] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:40.082313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.139979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:40.181274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b9310-94e6-4e44-ad72-d3e0cd4c20be None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.192469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac16b-9ef9-4868-b1be-f9e84d5ab4f9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.215984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.216793 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.217078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.217353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.225113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.226588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.230154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37e289-7d34-4434-b945-7ab78fa8da60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.230979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e289-7d34-4434-b945-7ab78fa8da60 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.231255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e289-7d34-4434-b945-7ab78fa8da60 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.231523 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e289-7d34-4434-b945-7ab78fa8da60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:40.241715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:40.242858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 291/580] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:40.243827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.245096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37e289-7d34-4434-b945-7ab78fa8da60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-8f37e289-7d34-4434-b945-7ab78fa8da60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:40.252824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:40.253825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 290/581] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:40.259896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37e289-7d34-4434-b945-7ab78fa8da60 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.322536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:40.361439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6cac5-7a8d-4115-9370-7fb618bbbba8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.368776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37e289-7d34-4434-b945-7ab78fa8da60 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.385766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:40.400320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.401233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.401341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.401538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.402419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:40.402730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.404163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.406656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.407399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.407686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.407960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.408681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:40.408990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.410390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.423489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 291/582] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:40.423991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 292/583] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:40.424226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.425312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.524737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1086-033c-4ddc-a800-21a1aeb0ed5a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.539507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8c3e9-6188-4009-bb87-c06024abd227 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.541686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:40.559065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.559740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.560021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.560295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.561134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:40.561445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.562940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.580193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.581150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.581449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 292/584] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:40.582204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.582308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.582764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.583784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:40.584297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.586279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.595135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 293/585] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:40.596032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.638235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:40.699241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9f87-3d2d-4128-8ef8-3b437b1da85a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.701078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c488f72-df09-4370-8d28-2e1e2f7acb5f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.734816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.735635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.735893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.736165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.736423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.737345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.737689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.738059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.745147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.746616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.746721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.748121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:40.761106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:40.762023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:40.762953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:40.762953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:40.762953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:40.762953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:40.762953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:40.762953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:40.762953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:40.762953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:40.765552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:40.766428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:40.768560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:40.768560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:40.768560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:40.768560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:40.768560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 293/586] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:40.768560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.769373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 294/587] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:40.769373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.798572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:40.876571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:40.877250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8324b44-6f77-4322-b831-25d07b05562c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.880593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9b03d-f4f6-4d4b-b789-a3379e6fd9af None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:40.913874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.914684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.914962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.915264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.918424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:40.919231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:40.919510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:40.919779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:40.926096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.927893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.930212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:40.931663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:40.947114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:40.948046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:40.948956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:40.948956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:40.948956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:40.948956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:40.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:40.950650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:40.951562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:40.951562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:40.951562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:40.951562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:40.951562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:40.951841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:40.955034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 294/589] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:40.955947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.045815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:41.059861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f9476-fed9-4b94-bdeb-3e8dc2794fa0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.067473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35609d-7e55-4e75-b387-7a60b8cb0fad None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.094875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.095633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.096033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.096310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.097110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:41.097415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.098959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.104449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.105697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.106166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.106580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.107864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:41.108576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.110110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.113629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 296/590] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:41.113629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.126662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 295/591] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:41.128607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:41.132134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.222276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f1726-0a1d-4490-976e-db06b0917edb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.242653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a5f31-dac7-42d3-aaf7-af17873d93cc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.258883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.259552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.259835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.260115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.260845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:41.261155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.262574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.276019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 297/592] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:41.276650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.281112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.281781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.282100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.282373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.283098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:41.283402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.284788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.294104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:41.299778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 296/593] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:41.300576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.355660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:41.387649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2966d49-7513-4a65-b889-403d88fdbcac None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.407578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f0197-7f66-4920-871c-fd556680cf4b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.429681 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e420cda-1126-4429-97ff-2385aaeb463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.431061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e420cda-1126-4429-97ff-2385aaeb463f None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.431473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e420cda-1126-4429-97ff-2385aaeb463f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.431758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e420cda-1126-4429-97ff-2385aaeb463f None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/10b3274005534830b0768b122769dd1a/roles/e113a817a4414021ba3aab63aadc0c22` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.449070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e420cda-1126-4429-97ff-2385aaeb463f None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=10b3274005534830b0768b122769dd1a, role_id=e113a817a4414021ba3aab63aadc0c22)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.449903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.450576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e420cda-1126-4429-97ff-2385aaeb463f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.451053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.451534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.451963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.460133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.462075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.466817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 298/594] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:59:41 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/10b3274005534830b0768b122769dd1a/roles/e113a817a4414021ba3aab63aadc0c22 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:41.467649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e420cda-1126-4429-97ff-2385aaeb463f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:41.488023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:41.489316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:41.490527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:41.490527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:41.490527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:41.490527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:41.490527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:41.490527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:41.490527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:41.490527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:41.493410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 297/595] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:41.494607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.587687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:41.602988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e420cda-1126-4429-97ff-2385aaeb463f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.629139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:41.647168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66250eb1-d402-469b-8c4e-7d35efd7d3c6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.649361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.651271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.651628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.652004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.661190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.663113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:41.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:41.679131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:41.680333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 299/596] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:41.680923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.700478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.701300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.701572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.701980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.710667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.712131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:41.727461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:41.728483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:41.729420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 298/597] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:41.730128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.789556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689fa1a-6c65-4f00-8b66-7149d5887190 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.823969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.824632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.824916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.825188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.826016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:41.826324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.828104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.840735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 300/598] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:41.841421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.852075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2855f75-c0e5-443e-a839-740c9520ecb8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:41.873572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:41.888557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dce31d-6bac-49dc-a097-b94c29b285c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:41.889299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce31d-6bac-49dc-a097-b94c29b285c7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.889843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce31d-6bac-49dc-a097-b94c29b285c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.889843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dce31d-6bac-49dc-a097-b94c29b285c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.890454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:41.890634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dce31d-6bac-49dc-a097-b94c29b285c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:41.890957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dce31d-6bac-49dc-a097-b94c29b285c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:41.892400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dce31d-6bac-49dc-a097-b94c29b285c7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:41.909299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 299/599] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:41.909299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466510ff-539e-4fb2-bc1a-60ab35050de3 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:41.909299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466510ff-539e-4fb2-bc1a-60ab35050de3 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:41.909299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466510ff-539e-4fb2-bc1a-60ab35050de3 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:41.909299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 300/600] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:41.909299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466510ff-539e-4fb2-bc1a-60ab35050de3 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:41.962442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793a2c-8aee-4e93-9e6e-f64494f74c8f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.001170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.001920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.002170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.002443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.003288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:42.003708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:42.005458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:42.015196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466510ff-539e-4fb2-bc1a-60ab35050de3 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.028450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 301/601] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 23 16:59:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:42.029568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:42.050941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0460c-8d03-4743-b20c-8b23a6080322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.052156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0460c-8d03-4743-b20c-8b23a6080322 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.052670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0460c-8d03-4743-b20c-8b23a6080322 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.052944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0460c-8d03-4743-b20c-8b23a6080322 None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/9c211cd37d7f49eaa916d332580135c9/roles/e113a817a4414021ba3aab63aadc0c22` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.070648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0460c-8d03-4743-b20c-8b23a6080322 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=9c211cd37d7f49eaa916d332580135c9, role_id=e113a817a4414021ba3aab63aadc0c22)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:42.072512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0460c-8d03-4743-b20c-8b23a6080322 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:42.097827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 301/602] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:59:41 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/9c211cd37d7f49eaa916d332580135c9/roles/e113a817a4414021ba3aab63aadc0c22 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:42.097827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f8b6-73f4-42db-82f8-08ef4039506e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.097827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f8b6-73f4-42db-82f8-08ef4039506e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.097827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f8b6-73f4-42db-82f8-08ef4039506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.123886 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a139f8b6-73f4-42db-82f8-08ef4039506e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:42.125137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a139f8b6-73f4-42db-82f8-08ef4039506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:42.138960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:42.143946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff6ddf-883a-4ff0-861e-40e247cd3641 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.163515 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:42.188281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a1a47-59c2-4dcb-821b-ef8292a86d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.189278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1a47-59c2-4dcb-821b-ef8292a86d79 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.189565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1a47-59c2-4dcb-821b-ef8292a86d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.189949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1a47-59c2-4dcb-821b-ef8292a86d79 None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/3c8b0c3534b84db68461b426a3f78773/roles/e113a817a4414021ba3aab63aadc0c22` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.208277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a1a47-59c2-4dcb-821b-ef8292a86d79 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=3c8b0c3534b84db68461b426a3f78773, role_id=e113a817a4414021ba3aab63aadc0c22)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:42.209916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a1a47-59c2-4dcb-821b-ef8292a86d79 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:42.218639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 302/603] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:42.219791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139f8b6-73f4-42db-82f8-08ef4039506e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:42.228478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 302/604] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:59:42 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/3c8b0c3534b84db68461b426a3f78773/roles/e113a817a4414021ba3aab63aadc0c22 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:42.250653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a1a47-59c2-4dcb-821b-ef8292a86d79 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:42.357941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139f8b6-73f4-42db-82f8-08ef4039506e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.377267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a1a47-59c2-4dcb-821b-ef8292a86d79 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.397503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.398508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.398853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.399191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.411519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:42.412945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:42.420624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc79389-2b1f-4223-bd1e-7da44a712cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.421823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc79389-2b1f-4223-bd1e-7da44a712cba None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.422294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc79389-2b1f-4223-bd1e-7da44a712cba None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.422741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc79389-2b1f-4223-bd1e-7da44a712cba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:42.432983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:42.433977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:42.434889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:42.434889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:42.434889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:42.434889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:42.436786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc79389-2b1f-4223-bd1e-7da44a712cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:42.437941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 303/605] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:42.440444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ffc79389-2b1f-4223-bd1e-7da44a712cba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:42.446392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:42.447335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:42.448190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:42.450968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 303/606] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:42.457604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc79389-2b1f-4223-bd1e-7da44a712cba None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:42.463892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:42.475288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:42.563073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd277a-3827-4442-9d34-d1ae82384a99 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.597405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.598236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.598470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.598712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.599459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:42.599789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:42.601171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:42.617905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 304/607] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:42.619371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:42.631066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc79389-2b1f-4223-bd1e-7da44a712cba None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.677139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.677780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.678114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.678403 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.679178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:42.679497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:42.680894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:42.694918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 304/608] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:42.695889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:42.723857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:42.769968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:42.788429 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433563-5830-4bbb-83fe-d8853777c875 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.803483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49db7-02df-4e9b-b9db-325e2e92fcc0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:42.840266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.841085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.841375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.841659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.854060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:42.855818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:42.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:42.877570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:42.878518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:42.878518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:42.878518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:42.878518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:42.878518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 305/609] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:42.883135 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:42.883616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:42.884035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:42.884240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:42.884510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:42.893725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:42.895267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:42.909855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:42.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:42.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:42.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:42.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:42.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:42.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:42.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:42.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:42.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:42.915869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 305/610] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:42.917059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:43.041066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51f9e6-07e2-452f-82c8-9dd2e9c4064d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:43.068663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:43.078657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:43.079334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:43.079915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:43.080724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:43.081466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:43.081776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:43.083813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:43.105966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 306/611] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:43.107240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:43.147768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce579065-2535-4bbf-8828-17972f8e5a99 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:43.211007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135be819-50d1-4c19-a150-d45a1097f80a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:43.239436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:43.249933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:43.250748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:43.251024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:43.251396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:43.255119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:43.255873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:43.256068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:43.256345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:43.257140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:43.257447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:43.258938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:43.262182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:43.263623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:43.280144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 306/612] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:43.286036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:43.290098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:43.291020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:43.292018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 307/613] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:43.300333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:43.397162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb8ac2-13e4-4fe3-ba2e-c46794e6379b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:43.424585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:43.446500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abadc8-72e5-4dbf-bba8-eec4ee8c1016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:43.448294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abadc8-72e5-4dbf-bba8-eec4ee8c1016 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:43.448785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abadc8-72e5-4dbf-bba8-eec4ee8c1016 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:43.449275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abadc8-72e5-4dbf-bba8-eec4ee8c1016 None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/2a92136d53514159a22faacb60ef0c50/roles/e113a817a4414021ba3aab63aadc0c22` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:43.484239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abadc8-72e5-4dbf-bba8-eec4ee8c1016 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=2a92136d53514159a22faacb60ef0c50, role_id=e113a817a4414021ba3aab63aadc0c22)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:43.485709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abadc8-72e5-4dbf-bba8-eec4ee8c1016 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:43.508629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 307/614] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:59:43 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/2a92136d53514159a22faacb60ef0c50/roles/e113a817a4414021ba3aab63aadc0c22 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:59:43.522587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10763a4-0b86-4088-b39a-f45269ca574b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:43.575972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b9751-7c8c-4b35-9e36-319488109aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:43.577391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9751-7c8c-4b35-9e36-319488109aba None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:43.578019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9751-7c8c-4b35-9e36-319488109aba None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:43.578544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9751-7c8c-4b35-9e36-319488109aba None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:43.579631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b9751-7c8c-4b35-9e36-319488109aba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:43.580212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b9751-7c8c-4b35-9e36-319488109aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:43.582042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b9751-7c8c-4b35-9e36-319488109aba None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:43.612924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 308/615] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 23 16:59:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:43.619230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abadc8-72e5-4dbf-bba8-eec4ee8c1016 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:43.690812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:43.783042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abadc8-72e5-4dbf-bba8-eec4ee8c1016 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:43.805321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac361d-ecf7-44ee-8365-37cfa59797e0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:43.806012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac361d-ecf7-44ee-8365-37cfa59797e0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:43.806407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac361d-ecf7-44ee-8365-37cfa59797e0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:43.808016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 309/616] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:43.815533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b31b4-3fa0-4a53-8de8-d9610973a50c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:43.815533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b31b4-3fa0-4a53-8de8-d9610973a50c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:43.815533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b31b4-3fa0-4a53-8de8-d9610973a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:43.834971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:43.835711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:43.835987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:43.836256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:43.837672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-817b31b4-3fa0-4a53-8de8-d9610973a50c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:43.838941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-817b31b4-3fa0-4a53-8de8-d9610973a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:43.856728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:43.858957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:43.882939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:43.883927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:43.884867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:43.884867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:43.884867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:43.884867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:43.886909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 308/617] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:43.893134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:43.919320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 310/618] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:43.966049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b31b4-3fa0-4a53-8de8-d9610973a50c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:44.010918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:44.018823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b07be-714a-4b59-9fd2-fe1e291520a0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:44.020505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:44.059682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:44.060501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.060902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.061270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.062273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:44.062683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:44.064397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:44.079179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 309/619] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:44.084773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:44.169926 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b31b4-3fa0-4a53-8de8-d9610973a50c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:44.247777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ab99-a288-4c1a-aa2c-97f0282e827f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:44.261758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934614f-7567-4b69-a89b-c4d151852dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:44.262599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934614f-7567-4b69-a89b-c4d151852dde None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.262882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934614f-7567-4b69-a89b-c4d151852dde None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.263152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934614f-7567-4b69-a89b-c4d151852dde None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.287683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934614f-7567-4b69-a89b-c4d151852dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1934614f-7567-4b69-a89b-c4d151852dde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:44.296879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:44.298028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:44.299301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 311/620] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:44.310866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:44.311674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.311960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.312234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.313689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934614f-7567-4b69-a89b-c4d151852dde None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:44.330268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:44.332244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:44.347104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:44.349957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:44.352207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 310/621] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:44.359676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:44.382140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:44.511422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:44.527553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934614f-7567-4b69-a89b-c4d151852dde None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:44.553963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd23c91-180f-4c63-b53b-41293a3fb5cc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:44.596281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4543a-c450-40fc-9a4f-4e50b60aee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:44.597366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4543a-c450-40fc-9a4f-4e50b60aee77 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.599570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4543a-c450-40fc-9a4f-4e50b60aee77 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.600067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4543a-c450-40fc-9a4f-4e50b60aee77 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.601362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4543a-c450-40fc-9a4f-4e50b60aee77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:44.603701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4543a-c450-40fc-9a4f-4e50b60aee77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:44.605325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4543a-c450-40fc-9a4f-4e50b60aee77 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:44.622322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 312/622] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:44.623752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9684538-ba3c-473b-852a-5079bcdd20c2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.624044 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9684538-ba3c-473b-852a-5079bcdd20c2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.624324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9684538-ba3c-473b-852a-5079bcdd20c2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.624826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d52811-2034-471f-9ede-b57d9b0d23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:44.625821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 313/623] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:44.626403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52811-2034-471f-9ede-b57d9b0d23ad None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.626939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52811-2034-471f-9ede-b57d9b0d23ad None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.627413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52811-2034-471f-9ede-b57d9b0d23ad None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.628395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d52811-2034-471f-9ede-b57d9b0d23ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:44.628897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d52811-2034-471f-9ede-b57d9b0d23ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:44.631131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d52811-2034-471f-9ede-b57d9b0d23ad None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:44.631269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9684538-ba3c-473b-852a-5079bcdd20c2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:44.648074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 311/624] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:44.654077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585455e-329f-4fdd-9f50-e884f22da2d6 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.654373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585455e-329f-4fdd-9f50-e884f22da2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.654659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585455e-329f-4fdd-9f50-e884f22da2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.672731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-5585455e-329f-4fdd-9f50-e884f22da2d6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:44.674090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5585455e-329f-4fdd-9f50-e884f22da2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:44.754114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9684538-ba3c-473b-852a-5079bcdd20c2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:44.762410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 312/625] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:44.763060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585455e-329f-4fdd-9f50-e884f22da2d6 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:44.766488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:44.798030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:44.799252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.799735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.800275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.813526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:44.815022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:44.833916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:44.834868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:44.835775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:44.835775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:44.835775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:44.835775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:44.835775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 314/626] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:44.836068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:44.845648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:44.882226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585455e-329f-4fdd-9f50-e884f22da2d6 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:44.916650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28413b5d-d985-4e39-b676-ab98bfca922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:44.917549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413b5d-d985-4e39-b676-ab98bfca922b None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.917857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413b5d-d985-4e39-b676-ab98bfca922b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.918131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413b5d-d985-4e39-b676-ab98bfca922b None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/08ffc7cdb0d54083bbedaa3e7441e099/roles/e113a817a4414021ba3aab63aadc0c22` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.933560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28413b5d-d985-4e39-b676-ab98bfca922b None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=08ffc7cdb0d54083bbedaa3e7441e099, role_id=e113a817a4414021ba3aab63aadc0c22)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:44.935073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28413b5d-d985-4e39-b676-ab98bfca922b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:44.944074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be287139-2cc0-484c-af24-822a9fef0c98 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:44.952397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 313/627] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:59:44 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/08ffc7cdb0d54083bbedaa3e7441e099/roles/e113a817a4414021ba3aab63aadc0c22 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:44.954038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1df39-bb32-4acf-a920-ea5989d9b8fd None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.954953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1df39-bb32-4acf-a920-ea5989d9b8fd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.955399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1df39-bb32-4acf-a920-ea5989d9b8fd None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.959023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 314/628] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:44.960874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1df39-bb32-4acf-a920-ea5989d9b8fd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:44.985309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee56f8-4c68-4804-9ebc-4601181c7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:44.986176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee56f8-4c68-4804-9ebc-4601181c7992 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:44.986460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee56f8-4c68-4804-9ebc-4601181c7992 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:44.986738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee56f8-4c68-4804-9ebc-4601181c7992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:44.999460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee56f8-4c68-4804-9ebc-4601181c7992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-49ee56f8-4c68-4804-9ebc-4601181c7992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:45.007810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:45.008855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:45.009693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:45.014015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 315/629] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:45.015418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a709c-21bd-4acf-a7a7-3ac5febc1f11 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.015708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a709c-21bd-4acf-a7a7-3ac5febc1f11 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.015988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a709c-21bd-4acf-a7a7-3ac5febc1f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.037886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9b3a709c-21bd-4acf-a7a7-3ac5febc1f11 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:45.039497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9b3a709c-21bd-4acf-a7a7-3ac5febc1f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:45.041470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:45.096631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1df39-bb32-4acf-a920-ea5989d9b8fd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.117732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:45.126823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 316/630] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:45.127997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a709c-21bd-4acf-a7a7-3ac5febc1f11 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.157062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.157737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.158041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.158364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.159106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:45.159419 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:45.160854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:45.180479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 315/631] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:45.181421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.251914 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a709c-21bd-4acf-a7a7-3ac5febc1f11 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.288165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905d4b5-f221-4d1c-bdb0-9fd62404ba64 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.290105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.291655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.292144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.292568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.293520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:45.294057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:45.295588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:45.303478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:45.306333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 317/632] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:45.307372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.325282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0681b-0801-4435-949c-cacf810ff265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.326211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0681b-0801-4435-949c-cacf810ff265 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.326555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0681b-0801-4435-949c-cacf810ff265 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.326909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0681b-0801-4435-949c-cacf810ff265 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.338087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0681b-0801-4435-949c-cacf810ff265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-ede0681b-0801-4435-949c-cacf810ff265 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:45.346051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:45.347023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:45.347869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:45.352647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 316/633] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:45.353620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0681b-0801-4435-949c-cacf810ff265 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.377470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:45.425373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148925b-7649-492a-b05e-e69a99cc2bee None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.461462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0681b-0801-4435-949c-cacf810ff265 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.464356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.465442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.465987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.466480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.476220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:45.478135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:45.494358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:45.495573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:45.496741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:45.498623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 318/634] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:45.499388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.504759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.505828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.506244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.506658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.518328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:45.520100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:45.538754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:45.539903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:45.541012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:45.541012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:45.541012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:45.541012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:45.543046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 317/635] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:45.544035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.574235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:45.618884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe555e-4d67-4e4a-80a6-fb80799ea40a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.637359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:45.649054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8067aa2-080c-4fa6-8c1f-f97a73d8b54d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.656565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.657334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.657720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.658091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.658925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:45.659307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:45.660990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:45.669842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 319/636] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:45.670861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.698376 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.699296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.699751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.700173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.701235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:45.701687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:45.703653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:45.722320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 318/637] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:45.723540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.782963 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004e0e5-2952-44ef-a741-dd63cbcb97c7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.811644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:45.820108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.821172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.821306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.821648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.822501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:45.822865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:45.824808 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:45.830879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13d87-450e-4a78-a078-aee71d5f53e8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.842873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 320/638] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:45.843978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.866685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.867753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.868308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.868756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:45.879250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:45.880992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:45.889833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:45.899266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:45.900372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:45.901518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:45.901518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:45.901518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:45.901518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:45.902620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 319/639] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:45.903533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:45.956932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a1761-23c2-4679-8597-a08f9ed08714 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:45.993527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cec5bd-114d-4daa-bd61-04e14f2166c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:45.994210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cec5bd-114d-4daa-bd61-04e14f2166c1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:45.994492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cec5bd-114d-4daa-bd61-04e14f2166c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:45.994763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cec5bd-114d-4daa-bd61-04e14f2166c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.009399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5217e2-acd5-462c-b136-e61a0ddf2927 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.042635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.043439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.043720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.043991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.046689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:46.052298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.054076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:46.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:46.069562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 16:59:46.070614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:46.072968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cec5bd-114d-4daa-bd61-04e14f2166c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.074102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 320/640] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:46.074465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cec5bd-114d-4daa-bd61-04e14f2166c1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.074943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.120785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:46.180518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807ef5-3d25-4946-a831-647dd06f0fed None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.184613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 321/641] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:46.185755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d31-094f-40b7-9b66-cd27c53e1f3b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.186067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d31-094f-40b7-9b66-cd27c53e1f3b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.186340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d31-094f-40b7-9b66-cd27c53e1f3b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.191629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 322/642] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:46.191629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d31-094f-40b7-9b66-cd27c53e1f3b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.222362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.223034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.223432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.223714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.224435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:46.224741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.226156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.237769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 321/643] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:46.238595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.300798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:46.303409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d31-094f-40b7-9b66-cd27c53e1f3b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.340906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0ae10-2ba7-4660-8afd-3b44ce546869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.341508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ae10-2ba7-4660-8afd-3b44ce546869 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.341814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ae10-2ba7-4660-8afd-3b44ce546869 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.342092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ae10-2ba7-4660-8afd-3b44ce546869 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.342938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0ae10-2ba7-4660-8afd-3b44ce546869 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:46.343247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0ae10-2ba7-4660-8afd-3b44ce546869 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.344693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0ae10-2ba7-4660-8afd-3b44ce546869 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.345240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d40f39-b475-4054-8954-19d56c707558 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.354478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:46.368728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 323/644] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:46.369708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b991-2c62-4cc8-8c53-c8bad88d4783 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.370013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b991-2c62-4cc8-8c53-c8bad88d4783 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.370346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b991-2c62-4cc8-8c53-c8bad88d4783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.384807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.385681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.386046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.386377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.387159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-17e6b991-2c62-4cc8-8c53-c8bad88d4783 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:46.388377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-17e6b991-2c62-4cc8-8c53-c8bad88d4783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:46.397164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.398796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:46.416529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:46.417632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:46.419188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:46.419188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:46.419188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:46.419188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:46.419188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 322/645] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:46.419188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.465664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 324/646] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:46.466689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6b991-2c62-4cc8-8c53-c8bad88d4783 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.530496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07155c7-f98f-4215-a8cd-67db39e1dc79 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.540773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:46.568975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.569958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.570357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.570681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.581159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.581570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6b991-2c62-4cc8-8c53-c8bad88d4783 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.582903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:46.599026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:46.600177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:46.601241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 323/647] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:46.601930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.616706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:46.625714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8ad83-05c6-4872-961e-859a30342614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.626515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ad83-05c6-4872-961e-859a30342614 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.626896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ad83-05c6-4872-961e-859a30342614 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.627272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ad83-05c6-4872-961e-859a30342614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.704073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8ad83-05c6-4872-961e-859a30342614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.705511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8ad83-05c6-4872-961e-859a30342614 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.725992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac67b23-cc64-4020-8c61-f128aa3f3250 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.762480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.763146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.763425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.763696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.764422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:46.764724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.766122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.779310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 324/648] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:46.780227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.813862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 325/649] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:46.814056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:46.814138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8ad83-05c6-4872-961e-859a30342614 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.839825 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:46.891608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e352cfa-9006-42cd-bb77-d74271ad7cc3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.916497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8ad83-05c6-4872-961e-859a30342614 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:46.931908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7e99a-b09e-4ac3-b4ff-6f962ec435dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.932723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7e99a-b09e-4ac3-b4ff-6f962ec435dc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.933010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7e99a-b09e-4ac3-b4ff-6f962ec435dc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.933285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7e99a-b09e-4ac3-b4ff-6f962ec435dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.945773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7e99a-b09e-4ac3-b4ff-6f962ec435dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:46.951602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1854-0151-4777-9510-aff048134700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:46.952635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1854-0151-4777-9510-aff048134700 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:46.952920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1854-0151-4777-9510-aff048134700 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:46.953194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1854-0151-4777-9510-aff048134700 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e7b7e99a-b09e-4ac3-b4ff-6f962ec435dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:46.953936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:46.954857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:46.961147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:46.961820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d1854-0151-4777-9510-aff048134700 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:46.961820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d1854-0151-4777-9510-aff048134700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:46.961969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 325/650] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:46.962042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d1854-0151-4777-9510-aff048134700 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:46.962118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7e99a-b09e-4ac3-b4ff-6f962ec435dc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:46.982965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 326/651] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:46.982965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1854-0151-4777-9510-aff048134700 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.056894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.070227 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.070445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7e99a-b09e-4ac3-b4ff-6f962ec435dc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.091205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1854-0151-4777-9510-aff048134700 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.105146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.105988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.106271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.106544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.113253 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.114799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.126103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.126911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.127189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.127445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:47.128939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:47.130032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 326/652] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:47.131464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.142532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.143942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:47.161769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:47.162930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:47.163888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:47.163888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:47.163888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:47.163888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:47.163888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 327/653] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:47.164177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.231090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd93fc-fdcc-4978-8a11-dcaaca86b651 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.264761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8cc8-aa96-43ed-87b4-6aca4fbd04fd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.266721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d962-a1cd-4cf6-b777-d0b181de303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.267416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d962-a1cd-4cf6-b777-d0b181de303c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.267691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d962-a1cd-4cf6-b777-d0b181de303c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.267966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d962-a1cd-4cf6-b777-d0b181de303c None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.268710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d962-a1cd-4cf6-b777-d0b181de303c None admin] RBAC: Adding query filter params (name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:47.269017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d962-a1cd-4cf6-b777-d0b181de303c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.270473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d962-a1cd-4cf6-b777-d0b181de303c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.278583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 327/654] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:47.279818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b7d8-0e61-4501-b686-616b45003119 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.280102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b7d8-0e61-4501-b686-616b45003119 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.280376 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b7d8-0e61-4501-b686-616b45003119 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.282075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 328/655] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:47.282318 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b7d8-0e61-4501-b686-616b45003119 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.294651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.304089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb0104-419a-4a2e-8e9e-7761db578528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.304742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0104-419a-4a2e-8e9e-7761db578528 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.305021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0104-419a-4a2e-8e9e-7761db578528 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.305295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0104-419a-4a2e-8e9e-7761db578528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.313314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.373727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb0104-419a-4a2e-8e9e-7761db578528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.375227 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb0104-419a-4a2e-8e9e-7761db578528 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.383382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b7d8-0e61-4501-b686-616b45003119 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.416926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.417504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.417784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.418086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.418869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:47.419173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.420593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.432841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 329/656] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:47.433756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.476959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 328/657] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:47.477830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb0104-419a-4a2e-8e9e-7761db578528 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.505041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.518060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.537120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ba0a-24a1-4874-a8e0-a890e4e60c6b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.573038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277d83-3b22-448d-80f1-74f5ac87f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.573699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277d83-3b22-448d-80f1-74f5ac87f23d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.574007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277d83-3b22-448d-80f1-74f5ac87f23d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.574295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277d83-3b22-448d-80f1-74f5ac87f23d None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.575389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc277d83-3b22-448d-80f1-74f5ac87f23d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:47.575698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc277d83-3b22-448d-80f1-74f5ac87f23d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.577470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc277d83-3b22-448d-80f1-74f5ac87f23d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.578347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb0104-419a-4a2e-8e9e-7761db578528 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.590315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 330/658] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:47.591624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d6102-c882-486a-a889-d8f760c7b90b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.591912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d6102-c882-486a-a889-d8f760c7b90b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.592177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d6102-c882-486a-a889-d8f760c7b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.608108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-637d6102-c882-486a-a889-d8f760c7b90b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:47.609324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-637d6102-c882-486a-a889-d8f760c7b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:47.612972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.613782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.614141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.614418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.624794 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.626270 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:47.644203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:47.645253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:47.646184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:47.646184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:47.646184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:47.646184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:47.646184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 329/659] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:47.646486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.675351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 331/660] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:47.676209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d6102-c882-486a-a889-d8f760c7b90b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.737273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.737866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.748113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096e150-a691-4c36-aa46-b146fa73208a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.779486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d6102-c882-486a-a889-d8f760c7b90b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.784553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.785208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.785488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.785881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.786720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=10b3274005534830b0768b122769dd1a) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:47.787028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.788565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.794609 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 330/661] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/role_assignments?user.id=10b3274005534830b0768b122769dd1a&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:47.795275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.821460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.822405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.822681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.822957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.835082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.836574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:47.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:47.859230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:47.860181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:47.860181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:47.860181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:47.860181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:47.860181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 332/662] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:47.860955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:47.924950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d11b0-c8a6-4995-b644-d2b12165c614 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.965915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:47.966955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:47.967381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:47.967804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:47.977315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:47.978418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ad90d-69a9-44e1-8b40-2cafe9fc56c3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:47.979207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:47.993591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:47.994999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:47.996155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:47.997212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 331/663] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:47.998009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.019737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:48.024743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.025833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.025833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.026034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.026719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:48.027023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.029044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.041832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 333/664] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:48.042525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.115368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a5e70-2a7c-4d7e-8f34-c85abed4876d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.150928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6da4-4254-4dc0-b6ba-bf71b7fa8cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.151737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6da4-4254-4dc0-b6ba-bf71b7fa8cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.152022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6da4-4254-4dc0-b6ba-bf71b7fa8cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.152298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6da4-4254-4dc0-b6ba-bf71b7fa8cb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.160802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6378f3-614e-4c67-a8ae-a892c55d4afd None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.162965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef6da4-4254-4dc0-b6ba-bf71b7fa8cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9eef6da4-4254-4dc0-b6ba-bf71b7fa8cb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:48.170697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:48.171881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 332/665] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:48.172769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6da4-4254-4dc0-b6ba-bf71b7fa8cb9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.206649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.207338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.208412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.208412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.208749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:48.209059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.210469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.226785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 334/666] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:48.226785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.254860 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:48.270411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:48.298613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6da4-4254-4dc0-b6ba-bf71b7fa8cb9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.331764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9c41c-5e75-4982-a80e-fe1289843867 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.332275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.333018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.333409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.333695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.334532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:48.334838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.336285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.350064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 333/667] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:48.350724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.374184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.375017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.375282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.375556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.383804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.385247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:48.399697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:48.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:48.401681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 335/668] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:48.402330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.465469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fcf2d-019c-440c-8660-5030ccab7e98 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.502655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.503254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:48.503797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.504273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.505363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.506378 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:48.506770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.508178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.509646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:48.516543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721348e3-2f5b-4152-a280-d54ef3533f84 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.523373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 334/669] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:48.523373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.554031 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.555075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.555514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.555884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.562972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.564433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:48.580218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:48.581177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:48.582098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 336/670] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:48.582634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.637768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa44a0-e5b6-4a42-a7a5-9a7ec8aa4b3e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.672345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.673005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.673290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.673565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.674445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=3c8b0c3534b84db68461b426a3f78773) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:48.674763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.676199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.684833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 335/671] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/role_assignments?user.id=3c8b0c3534b84db68461b426a3f78773&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:48.685105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.704469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467753ed-bf53-4805-a941-cdf560c3e330 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.747408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.748246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.748439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.748717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.750306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:48.750306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.751525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.777678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 337/672] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:48.778752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.787494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:48.795944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:48.847310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f087f-5954-49b4-96dc-655e7af4d57c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.886851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.887669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.887951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.888216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.900997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.902514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.919481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e1043-07e8-469b-ad72-751ef2e5e8a0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:48.921073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:48.921988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:48.922907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:48.922907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:48.922907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:48.922907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:48.922907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 336/673] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:48.924399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:48.965554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:48.966254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:48.966533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:48.966804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:48.967636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:48.967949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:48.969450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:48.982920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 338/674] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:48.984004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:49.070703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03de7-fb25-421e-8b64-4908f154db0e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.072485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:49.089518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:49.113612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeec3b-cde8-4bd7-b491-9b0a8ba9a65a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.121596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f1fd8-3f23-4025-8b2f-cec32c6149e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:49.122979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f1fd8-3f23-4025-8b2f-cec32c6149e8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:49.123404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f1fd8-3f23-4025-8b2f-cec32c6149e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:49.124283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f1fd8-3f23-4025-8b2f-cec32c6149e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:49.152650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:49.152983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:49.153267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:49.153545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:49.154389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:49.154616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:49.156036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:49.176211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 339/675] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:49.176211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:49.211589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f1fd8-3f23-4025-8b2f-cec32c6149e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:49.213088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f1fd8-3f23-4025-8b2f-cec32c6149e8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:49.304901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22127b82-c755-414f-b397-311c3b933ad2 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.317904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 337/676] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:49.319056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f1fd8-3f23-4025-8b2f-cec32c6149e8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:49.336042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:49.347198 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:49.357739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:49.358611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:49.359036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:49.359468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:49.361656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=9c211cd37d7f49eaa916d332580135c9) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:49.362146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:49.363706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:49.371866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 340/677] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:49 2022] GET /identity/v3/role_assignments?user.id=9c211cd37d7f49eaa916d332580135c9&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:49.373088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:49.496594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68a6a3-c080-4596-8b1d-53cf0c5f25bf None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.526657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f1fd8-3f23-4025-8b2f-cec32c6149e8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.536965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:49.537768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:49.538077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:49.538342 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:49.549403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:49.550894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:49.569390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:49.570406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:49.571307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:49.571307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:49.571307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:49.571307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:49.574195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:49.575042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 341/678] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:49.575468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:49.575961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:49.576302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:49.576633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:49.585509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:49.587490 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:49.609049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:49.610094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 16:59:49.611138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:49.614132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 338/679] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:49.620124 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:49.647809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:49.718374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:49.721229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bbfa3-ad7b-4235-aa79-dc6716a1efbc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.760062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ffb87-bb8b-4c37-b386-a2fb3827ae2b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.767919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:49.769125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:49.769583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:49.770265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:49.771272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:49.771577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:49.772965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:49.788218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 342/680] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:49.793853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:49.806356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:49.807038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:49.807311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:49.807576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:49.808424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:49.808724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:49.810231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:49.833033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 339/681] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 23 16:59:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:49.836206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:49.932249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c7592-73e3-47f3-b27d-a7099b6f8904 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.941724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:49.962657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e966e-fc31-47ff-bd07-ea9dfd5f4bd9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:49.974900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:49.975712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:49.975989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:49.976259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:49.983880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:49.985469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:49.993186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:49.999409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5da1da-fb62-4148-b186-365e8145969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.000246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da1da-fb62-4148-b186-365e8145969f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.000683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da1da-fb62-4148-b186-365e8145969f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.001134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da1da-fb62-4148-b186-365e8145969f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:50.003158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:50.004049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:50.005038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:50.005038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:50.005038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:50.005038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:50.005038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:50.005038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:50.005038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:50.005038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:50.009451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 343/682] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:50.010771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.070087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da1da-fb62-4148-b186-365e8145969f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:50.071567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da1da-fb62-4148-b186-365e8145969f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:50.116908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6c5f-9c37-44c5-866b-6e67b48ffdf7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:50.162377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.163359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.163999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.164274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.165334 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:50.165643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:50.167992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:50.173626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 340/683] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 16:59:50.175121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b09a90-b4cb-4d76-9bac-6e092bff57ce None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.175506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b09a90-b4cb-4d76-9bac-6e092bff57ce None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.175879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b09a90-b4cb-4d76-9bac-6e092bff57ce None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.177678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 341/684] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:50.183443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76690-3cd3-4e76-85a2-06809ff93e14 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.183786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76690-3cd3-4e76-85a2-06809ff93e14 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.184431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a76690-3cd3-4e76-85a2-06809ff93e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.189881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 344/685] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:50.190763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.205085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d1a76690-3cd3-4e76-85a2-06809ff93e14 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:50.206299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d1a76690-3cd3-4e76-85a2-06809ff93e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:50.219943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:50.234282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:50.280935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 342/686] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:50.281835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a76690-3cd3-4e76-85a2-06809ff93e14 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.294885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe57970-bc84-4177-86b1-7940851842c6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:50.330182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.331098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.331444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.331788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.344185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:50.345749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:50.367206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:50.368158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:50.369101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:50.369101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:50.369101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:50.369101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:50.369612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 345/687] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:50.370291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.395379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a76690-3cd3-4e76-85a2-06809ff93e14 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:50.432599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.433283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.433622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.433916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.434878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=2a92136d53514159a22faacb60ef0c50) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:50.435187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:50.436694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:50.450032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 343/688] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/role_assignments?user.id=2a92136d53514159a22faacb60ef0c50&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:50.451262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.470956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:50.501128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad71f76-f685-4729-9472-49e1d6fa247a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:50.505450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:50.548794 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b8890-56fe-43de-9baf-6dbbc92dac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.549625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8890-56fe-43de-9baf-6dbbc92dac7b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.549939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8890-56fe-43de-9baf-6dbbc92dac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.550215 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8890-56fe-43de-9baf-6dbbc92dac7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.562935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b8890-56fe-43de-9baf-6dbbc92dac7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-a23b8890-56fe-43de-9baf-6dbbc92dac7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:50.571266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:50.572479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:50.573359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 346/689] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:50.578733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b8890-56fe-43de-9baf-6dbbc92dac7b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.656813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd847ab-5e2d-4618-9404-8a8c9a2559a2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:50.696046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.697079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.697562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.698065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.699004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:50.699523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:50.701132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:50.717123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 344/690] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:50.724149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.724748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b8890-56fe-43de-9baf-6dbbc92dac7b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:50.765663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.766426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.766710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.766982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.767836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:50.768147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:50.769526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:50.782890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 347/691] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:50.783267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:50.789826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.844783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:50.874021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09e5b-a9f9-4e57-b675-71319556f3cc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:50.922654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.923744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.924025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.924299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.924940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d88b-0066-42a0-8b90-bd812b33e8ae None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:50.933311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:50.935267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:50.955335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:50.956334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:50.957249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:50.957249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:50.957249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:50.957249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:50.957249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:50.957249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:50.957249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:50.957249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:50.957883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 345/692] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:50.963603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:50.966011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:50.966887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:50.967220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:50.967499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:50.985823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:50.987322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:51.019367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:51.022214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:51.024343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:51.024343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:51.024343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:51.024343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:51.024343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 348/693] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:51.031194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:51.110407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:51.111854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b0e4-1f7d-4178-b0a1-a1b66be864bc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:51.149125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5df97-310b-4521-91f3-6799326a0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:51.150052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5df97-310b-4521-91f3-6799326a0cbc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.150340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5df97-310b-4521-91f3-6799326a0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.150619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5df97-310b-4521-91f3-6799326a0cbc None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.151422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5df97-310b-4521-91f3-6799326a0cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:51.151735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5df97-310b-4521-91f3-6799326a0cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:51.153191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5df97-310b-4521-91f3-6799326a0cbc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.169942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 346/694] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:51.170666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ad849-2542-46a0-abcd-1ff713d1ef88 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:51.171325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b07a1-ab57-4b79-9f83-18fd45c67481 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.171619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b07a1-ab57-4b79-9f83-18fd45c67481 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.171901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b07a1-ab57-4b79-9f83-18fd45c67481 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.175239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 347/695] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:51.176002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b07a1-ab57-4b79-9f83-18fd45c67481 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:51.184048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:51.218691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8bb5-f32a-4091-b675-9e87544627e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:51.220357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8bb5-f32a-4091-b675-9e87544627e2 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.220653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8bb5-f32a-4091-b675-9e87544627e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.220932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8bb5-f32a-4091-b675-9e87544627e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.221672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8bb5-f32a-4091-b675-9e87544627e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:51.222010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8bb5-f32a-4091-b675-9e87544627e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:51.223488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8bb5-f32a-4091-b675-9e87544627e2 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.239686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 349/696] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:51.241269 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fadf5-8890-4078-a167-542947d805bd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.241629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fadf5-8890-4078-a167-542947d805bd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.242006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fadf5-8890-4078-a167-542947d805bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.267275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0f0fadf5-8890-4078-a167-542947d805bd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:51.268587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0f0fadf5-8890-4078-a167-542947d805bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:51.295123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b07a1-ab57-4b79-9f83-18fd45c67481 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:51.334062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:51.334728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.335059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.335337 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.336230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=08ffc7cdb0d54083bbedaa3e7441e099) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:51.336547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:51.338049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.350212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 348/697] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:51 2022] GET /identity/v3/role_assignments?user.id=08ffc7cdb0d54083bbedaa3e7441e099&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:51.351223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:51.354695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 350/698] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:51.380312 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fadf5-8890-4078-a167-542947d805bd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:51.438401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:51.495994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:51.510697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fadf5-8890-4078-a167-542947d805bd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:51.553988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:51.554832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.555117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.555395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.556062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:51.556549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78869eee-6725-435e-be4c-c25d34c5fe29 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:51.557443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:51.573590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:51.575917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:51.578265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 351/699] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 23 16:59:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:51.588107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:51.599175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:51.604618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.604618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.604618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.611964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:51.613744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:51.634597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:51.635650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:51.636602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 349/700] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 16:59:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:51.641550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:51.739969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43166ca9-d0ff-44b5-a5c8-b3491439d9d6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:51.749161 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:51.786990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:51.787682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.788181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.788465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.788860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020d12-ce53-4eb7-b36e-9e3baff791ca None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:51.789194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:51.789506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:51.791769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.797051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 352/701] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 23 16:59:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:51.802392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:51.820948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:51.830214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:51.831209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.831632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.832113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.833265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:51.833754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:51.835529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.855039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 350/702] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 16:59:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:51.871079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:51.922128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442611e-6403-49d8-bccb-d5c830e7d658 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:51.964205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5a66f-51ff-4234-9a58-5b69703354af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:51.964205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a66f-51ff-4234-9a58-5b69703354af None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:51.964205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a66f-51ff-4234-9a58-5b69703354af None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:51.964205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a66f-51ff-4234-9a58-5b69703354af None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:51.964642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a66f-51ff-4234-9a58-5b69703354af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:51.964642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a66f-51ff-4234-9a58-5b69703354af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:51.965833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a66f-51ff-4234-9a58-5b69703354af None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:51.980934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 353/703] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 23 16:59:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:52.128284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a286e-bae1-4808-ba53-604171b5528b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:52.166019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646b48-77aa-4994-aa10-02148299636e None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:52.166345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646b48-77aa-4994-aa10-02148299636e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:52.166606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8646b48-77aa-4994-aa10-02148299636e None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:52.168238 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 354/704] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:52.173567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd039473-6f45-46b3-b0d2-4e04b3670687 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:52.173888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd039473-6f45-46b3-b0d2-4e04b3670687 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:52.174162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd039473-6f45-46b3-b0d2-4e04b3670687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:52.198672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-cd039473-6f45-46b3-b0d2-4e04b3670687 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:52.199943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-cd039473-6f45-46b3-b0d2-4e04b3670687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:52.214772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc04478-751c-416c-8b79-cb8fff46cac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:52.214772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04478-751c-416c-8b79-cb8fff46cac5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:52.214772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04478-751c-416c-8b79-cb8fff46cac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:52.214772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04478-751c-416c-8b79-cb8fff46cac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:52.258199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:52.333822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:52.358745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc04478-751c-416c-8b79-cb8fff46cac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:52.360302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc04478-751c-416c-8b79-cb8fff46cac5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:52.364099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 355/705] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:52.422998 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd039473-6f45-46b3-b0d2-4e04b3670687 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:52.472438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 351/706] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:52.478017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc04478-751c-416c-8b79-cb8fff46cac5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:52.573234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:52.592675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc04478-751c-416c-8b79-cb8fff46cac5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:52.647286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:52.648256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:52.648542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:52.648822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:52.662015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:52.663752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:52.693974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:52.695100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:52.696195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:52.696195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:52.696195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:52.696195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:52.696195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 352/707] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:52.701294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:52.795993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd039473-6f45-46b3-b0d2-4e04b3670687 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:52.814260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71c9b6-ddbf-4ca4-82dd-c9ef6ece8717 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:52.856710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:52.857406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:52.857691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:52.857997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:52.858887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:52.859212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:52.864199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:52.868088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:52.870502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:52.871356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:52.871928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:52.871928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:52.875645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 353/708] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:52.881667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:52.897881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:52.899277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:52.955081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:52.956094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:52.957042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:52.957042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:52.957042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:52.957042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:52.957042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 356/709] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 534 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:52.962545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:52.994188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:52.998714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b03ab-d5ea-4752-a3c1-e6b32fabe663 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:53.041558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:53.042746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.044641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.045105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.060621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:53.065040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:53.093852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:53.094865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:53.095842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:53.095842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:53.095842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:53.095842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:53.095842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:53.095842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:53.095842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:53.095842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:53.099050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 354/710] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:53.105047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:53.188668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96018-ae98-4822-94af-a8ab8fb7d0d3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:53.198192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:53.221672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2235e6-ca02-4016-9d82-ba993c54f7a4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:53.224487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed04bb-ed20-42a8-bfc4-28f295bbc4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:53.225418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed04bb-ed20-42a8-bfc4-28f295bbc4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.225963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed04bb-ed20-42a8-bfc4-28f295bbc4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.226435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed04bb-ed20-42a8-bfc4-28f295bbc4a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.227359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed04bb-ed20-42a8-bfc4-28f295bbc4a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:53.227892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed04bb-ed20-42a8-bfc4-28f295bbc4a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:53.229472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed04bb-ed20-42a8-bfc4-28f295bbc4a1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:53.242163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 357/711] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:53.243698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c2220-3b69-40a6-b299-a64686a00314 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.244183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c2220-3b69-40a6-b299-a64686a00314 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.244655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c2220-3b69-40a6-b299-a64686a00314 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.250405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 358/712] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:53.251441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c2220-3b69-40a6-b299-a64686a00314 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:53.260099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602dfb4-0f9c-4e90-b047-c2e85645a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:53.261170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602dfb4-0f9c-4e90-b047-c2e85645a527 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.261464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602dfb4-0f9c-4e90-b047-c2e85645a527 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.261748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602dfb4-0f9c-4e90-b047-c2e85645a527 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.262596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602dfb4-0f9c-4e90-b047-c2e85645a527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:53.262908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602dfb4-0f9c-4e90-b047-c2e85645a527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:53.264717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602dfb4-0f9c-4e90-b047-c2e85645a527 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:53.279971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 355/713] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:53.286432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809228f7-ef65-48bd-8e16-b10a7d321a29 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.286432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809228f7-ef65-48bd-8e16-b10a7d321a29 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.286761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809228f7-ef65-48bd-8e16-b10a7d321a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.303484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-809228f7-ef65-48bd-8e16-b10a7d321a29 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:53.304911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-809228f7-ef65-48bd-8e16-b10a7d321a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:53.336462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:53.363333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c2220-3b69-40a6-b299-a64686a00314 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:53.377816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 356/714] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:53.377816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809228f7-ef65-48bd-8e16-b10a7d321a29 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:53.422824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf0250-2e75-46f1-8eab-42a353429a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:53.423906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0250-2e75-46f1-8eab-42a353429a18 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.424155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:53.424587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0250-2e75-46f1-8eab-42a353429a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.425055 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf0250-2e75-46f1-8eab-42a353429a18 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.426032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf0250-2e75-46f1-8eab-42a353429a18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:53.427908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf0250-2e75-46f1-8eab-42a353429a18 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:53.452400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 359/715] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 16:59:53 2022] POST /identity/v3/users => generated 254 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:53.453399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf0250-2e75-46f1-8eab-42a353429a18 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:53.490299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809228f7-ef65-48bd-8e16-b10a7d321a29 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:53.532076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:53.534128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.534820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.536793 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.538113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=10b3274005534830b0768b122769dd1a) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:53.539668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:53.542488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:53.557810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 357/716] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:53 2022] GET /identity/v3/role_assignments?user.id=10b3274005534830b0768b122769dd1a&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:53.646207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf0250-2e75-46f1-8eab-42a353429a18 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:53.681839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:53.690683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:53.690683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.690927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.691149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.691906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:53.693308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:53.706624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:53.707940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 16:59:53.708954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:53.716139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 360/717] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:53 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:53.721753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:53.839717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0083f-72d9-45aa-ad17-e64462839394 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:53.853931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:53.875688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38541fe-181c-4b2c-a45c-2763a47b25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:53.876613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38541fe-181c-4b2c-a45c-2763a47b25b2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:53.876901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38541fe-181c-4b2c-a45c-2763a47b25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:53.877179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38541fe-181c-4b2c-a45c-2763a47b25b2 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:53.877940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38541fe-181c-4b2c-a45c-2763a47b25b2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:53.878253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38541fe-181c-4b2c-a45c-2763a47b25b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:53.879970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38541fe-181c-4b2c-a45c-2763a47b25b2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:53.885160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 358/718] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 16:59:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:53.891064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:54.009644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c688-a92e-46f2-8f14-efeb819475e8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:54.023981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d95e-6177-423d-9d4b-e556447e95a2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.024295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d95e-6177-423d-9d4b-e556447e95a2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.024548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d95e-6177-423d-9d4b-e556447e95a2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.025954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 359/719] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:54.031377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d170d5-00d4-4e7c-a52f-b9904b1d2a69 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.031891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d170d5-00d4-4e7c-a52f-b9904b1d2a69 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.032362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d170d5-00d4-4e7c-a52f-b9904b1d2a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.049564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:54.050269 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.050552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.050832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.052570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:54.052881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:54.054374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:54.065834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 361/720] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 16:59:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:54.079070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a0d170d5-00d4-4e7c-a52f-b9904b1d2a69 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:54.080532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a0d170d5-00d4-4e7c-a52f-b9904b1d2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:54.192957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 360/721] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:54.228103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:54.320077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:54.365280 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95cddc-cb6f-4f26-b056-ba96c84df0e5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:54.398263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522ec0d-e139-4fe9-ba58-b3650df01062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:54.399120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522ec0d-e139-4fe9-ba58-b3650df01062 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.399398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522ec0d-e139-4fe9-ba58-b3650df01062 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.399670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522ec0d-e139-4fe9-ba58-b3650df01062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.409775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522ec0d-e139-4fe9-ba58-b3650df01062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e522ec0d-e139-4fe9-ba58-b3650df01062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:54.417576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:54.418584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:54.419438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 362/722] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:54.424734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d170d5-00d4-4e7c-a52f-b9904b1d2a69 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:54.545835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d170d5-00d4-4e7c-a52f-b9904b1d2a69 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:54.556113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:54.594459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc98c6-8a56-47a7-8acb-09255105ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:54.595138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc98c6-8a56-47a7-8acb-09255105ea9a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.595418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc98c6-8a56-47a7-8acb-09255105ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.595691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc98c6-8a56-47a7-8acb-09255105ea9a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.596446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc98c6-8a56-47a7-8acb-09255105ea9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:54.596750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc98c6-8a56-47a7-8acb-09255105ea9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:54.598346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc98c6-8a56-47a7-8acb-09255105ea9a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:54.607329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 361/723] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:54.613730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522ec0d-e139-4fe9-ba58-b3650df01062 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:54.619226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ab7a-cfde-4a2e-8562-85f3e85a3932 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.619513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ab7a-cfde-4a2e-8562-85f3e85a3932 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.619829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ab7a-cfde-4a2e-8562-85f3e85a3932 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.625823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 362/724] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:54.635388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b68b5c-493d-4b07-a810-4e95c1189f0e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.635667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b68b5c-493d-4b07-a810-4e95c1189f0e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.635938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b68b5c-493d-4b07-a810-4e95c1189f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.662911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e2b68b5c-493d-4b07-a810-4e95c1189f0e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:54.664109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e2b68b5c-493d-4b07-a810-4e95c1189f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:54.776314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 363/725] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:54.808692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b68b5c-493d-4b07-a810-4e95c1189f0e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:54.829300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522ec0d-e139-4fe9-ba58-b3650df01062 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:54.876847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:54.930613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:54.932278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.932761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.933233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.934553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:54.938498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b68b5c-493d-4b07-a810-4e95c1189f0e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:54.955857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:54.957614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:54.977567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e1ac-277f-4f37-a1ea-7096cd928b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:54.978280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e1ac-277f-4f37-a1ea-7096cd928b2a None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:54.978619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e1ac-277f-4f37-a1ea-7096cd928b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:54.978906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e1ac-277f-4f37-a1ea-7096cd928b2a None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:54.980122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e1ac-277f-4f37-a1ea-7096cd928b2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:54.981892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e1ac-277f-4f37-a1ea-7096cd928b2a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:54.990869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:54.992021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:54.993114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:54.993114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:54.993114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:54.993114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:54.994788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 363/726] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:55.000738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:55.035805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 364/727] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 16:59:54 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:59:55.119271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07ab9-f234-426e-bcf4-b349e459ec96 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:55.164835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:55.165548 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:55.165869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:55.166150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:55.166882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:55.167189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:55.168616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:55.182506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 364/728] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:55.187782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e1ac-277f-4f37-a1ea-7096cd928b2a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:55.334922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e1ac-277f-4f37-a1ea-7096cd928b2a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:55.373240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:55.374015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:55.374347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:55.374625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:55.382883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:55.384357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:55.399275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:55.400256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:55.401365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 365/729] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:55.406302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:55.436124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:55.512688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f87b6-bfd1-4428-8855-14b45e29b047 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:55.548392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:55.549076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:55.549360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:55.549637 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:55.550516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:55.550826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:55.552503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:55.571200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 365/730] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 23 16:59:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:55.578967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:55.607258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:55.697831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071df3-0a25-4e4e-8eb5-e8930292a6b3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:55.728564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757b3db-000e-4db3-aa77-7fb392b4f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:55.729224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b3db-000e-4db3-aa77-7fb392b4f0bf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:55.729506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b3db-000e-4db3-aa77-7fb392b4f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:55.729784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b3db-000e-4db3-aa77-7fb392b4f0bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:55.799958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757b3db-000e-4db3-aa77-7fb392b4f0bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:55.801763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757b3db-000e-4db3-aa77-7fb392b4f0bf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:55.823520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:55.904696 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 366/731] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 16:59:55.911160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.002126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:56.015444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39a4b4-b8e2-44c5-9fec-6a41d47bcce0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.050976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.051995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.052282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.052556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.063459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:56.065050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:56.070638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69746b8a-d0c2-4d3a-a15c-716f7468ab98 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.070927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69746b8a-d0c2-4d3a-a15c-716f7468ab98 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.071209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69746b8a-d0c2-4d3a-a15c-716f7468ab98 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.072855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 367/732] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:56.078592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c958-ff2c-4bb9-8fb6-ae6ab3374f0c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.078880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c958-ff2c-4bb9-8fb6-ae6ab3374f0c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.079155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c958-ff2c-4bb9-8fb6-ae6ab3374f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:56.093643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:56.094660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:56.095556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:56.095556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:56.095556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:56.095556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 16:59:56.097202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8b23c958-ff2c-4bb9-8fb6-ae6ab3374f0c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:56.097864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 366/733] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:56.098524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8b23c958-ff2c-4bb9-8fb6-ae6ab3374f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:56.103512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.174875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 368/734] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 16:59:56.198521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0398-cc61-4e4e-9507-12c38efe771f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.198836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0398-cc61-4e4e-9507-12c38efe771f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.199086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0398-cc61-4e4e-9507-12c38efe771f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.200599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 369/735] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:56.205518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0398-cc61-4e4e-9507-12c38efe771f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.256760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:56.263868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6e9a0-ca4d-4a0b-b8dd-5f6ce63d6082 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.298472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8a6b4-20ce-498c-879e-2ff67feeb19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.299143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8a6b4-20ce-498c-879e-2ff67feeb19d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.299419 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8a6b4-20ce-498c-879e-2ff67feeb19d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.299690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8a6b4-20ce-498c-879e-2ff67feeb19d None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.300416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8a6b4-20ce-498c-879e-2ff67feeb19d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:56.300722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8a6b4-20ce-498c-879e-2ff67feeb19d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:56.302386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8a6b4-20ce-498c-879e-2ff67feeb19d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:56.315361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:56.315590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0398-cc61-4e4e-9507-12c38efe771f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.319712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 367/736] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:59:56.321154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f61b2-8952-479c-ac45-ff7084044761 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.321616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f61b2-8952-479c-ac45-ff7084044761 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.321929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f61b2-8952-479c-ac45-ff7084044761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.342154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-068f61b2-8952-479c-ac45-ff7084044761 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:56.343816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-068f61b2-8952-479c-ac45-ff7084044761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:56.355141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f158-5305-45e2-8089-bb4161da6b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.356210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f158-5305-45e2-8089-bb4161da6b8a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.356689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f158-5305-45e2-8089-bb4161da6b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.357134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f158-5305-45e2-8089-bb4161da6b8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.368973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43f158-5305-45e2-8089-bb4161da6b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-dc43f158-5305-45e2-8089-bb4161da6b8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:56.377741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:56.379003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 16:59:56.380119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:56.387463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 370/737] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:56.388797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f158-5305-45e2-8089-bb4161da6b8a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.421968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 368/738] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:56.423141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f61b2-8952-479c-ac45-ff7084044761 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.501442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f158-5305-45e2-8089-bb4161da6b8a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.513689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:56.543666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f61b2-8952-479c-ac45-ff7084044761 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.548977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.549810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.550097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.550371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.559142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:56.560758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:56.574921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:56.579259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:56.580161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:56.581077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:56.581077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:56.581077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:56.581077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:56.581077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:56.581077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:56.581077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:56.581077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:56.585681 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 371/739] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:56.586860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.591149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.592119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.592635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.593136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.594153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:56.594661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:56.596329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:56.610521 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 369/740] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:56.611755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.703028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149fbeb-2935-47cc-962c-e680fcce2344 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.741123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037614-df96-416b-9cfb-a4706d5a3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.742394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037614-df96-416b-9cfb-a4706d5a3871 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.742946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037614-df96-416b-9cfb-a4706d5a3871 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.743522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037614-df96-416b-9cfb-a4706d5a3871 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.746757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d6af-d38b-4bc4-8ae1-b7eb9a70edb3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.755703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a037614-df96-416b-9cfb-a4706d5a3871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8a037614-df96-416b-9cfb-a4706d5a3871 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:56.763315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:56.764494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 372/741] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:56.765392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037614-df96-416b-9cfb-a4706d5a3871 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.786332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e11a54-fba5-4c95-a9c3-4fe500e9cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.787316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11a54-fba5-4c95-a9c3-4fe500e9cf4f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.787600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11a54-fba5-4c95-a9c3-4fe500e9cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.787874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11a54-fba5-4c95-a9c3-4fe500e9cf4f None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.788657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e11a54-fba5-4c95-a9c3-4fe500e9cf4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:56.788965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e11a54-fba5-4c95-a9c3-4fe500e9cf4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:56.790432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e11a54-fba5-4c95-a9c3-4fe500e9cf4f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:56.796137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:56.807875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 370/742] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:56.807875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3686eb-b8f4-4bfe-9ba1-cede6b0f36d1 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.807875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3686eb-b8f4-4bfe-9ba1-cede6b0f36d1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.807875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3686eb-b8f4-4bfe-9ba1-cede6b0f36d1 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.807875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 371/743] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:56.807875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3686eb-b8f4-4bfe-9ba1-cede6b0f36d1 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.858278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:56.884684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037614-df96-416b-9cfb-a4706d5a3871 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.909534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3686eb-b8f4-4bfe-9ba1-cede6b0f36d1 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:56.920299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.921097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.921378 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.921647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.932844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:56.934241 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:56.944356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008490b7-a7c5-4703-ac95-e262eb76ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:56.945012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008490b7-a7c5-4703-ac95-e262eb76ac21 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.945290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008490b7-a7c5-4703-ac95-e262eb76ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.945562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008490b7-a7c5-4703-ac95-e262eb76ac21 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.946339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008490b7-a7c5-4703-ac95-e262eb76ac21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:56.946641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008490b7-a7c5-4703-ac95-e262eb76ac21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:56.947990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008490b7-a7c5-4703-ac95-e262eb76ac21 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:56.951805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:56.953054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:56.954433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:56.954433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:56.954433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:56.954433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:56.954433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 373/744] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:56.954433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:56.961315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 372/745] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:56.963174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a98e0-df31-493a-8054-46ae2a21156a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:56.964231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a98e0-df31-493a-8054-46ae2a21156a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:56.964746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a98e0-df31-493a-8054-46ae2a21156a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:56.987233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-cb5a98e0-df31-493a-8054-46ae2a21156a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:56.989111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-cb5a98e0-df31-493a-8054-46ae2a21156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:57.036573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:57.058336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722fa7f-1cd1-42ae-88f5-a87fa9f83ddd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.073815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 373/746] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 16:59:57.073815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a98e0-df31-493a-8054-46ae2a21156a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:57.106238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.107075 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.107357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.107631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.108519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=08ffc7cdb0d54083bbedaa3e7441e099) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:57.108835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:57.110327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:57.115950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 374/747] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:56 2022] GET /identity/v3/role_assignments?user.id=08ffc7cdb0d54083bbedaa3e7441e099&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:57.116560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:57.116735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:57.210826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a98e0-df31-493a-8054-46ae2a21156a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.246821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf3440-bf6a-43bd-8515-4284c1ec8be9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.260228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.261053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.261330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.261604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.262414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:57.262721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:57.264788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:57.283038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 374/748] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:57.283038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:57.292965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.293858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.294236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.294603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.308545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:57.310430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:57.313636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:57.330766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:57.331734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:57.332712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:57.332712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:57.332712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:57.332712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:57.335023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 375/749] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:57.336030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:57.404597 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853797c3-2083-4bc4-b62f-63ead3308706 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.406454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:57.443369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee5f83-d43d-4e35-bf28-dbfb63bcd60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.444435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5f83-d43d-4e35-bf28-dbfb63bcd60f None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.444988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5f83-d43d-4e35-bf28-dbfb63bcd60f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.445512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee5f83-d43d-4e35-bf28-dbfb63bcd60f None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.446288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68542675-c98e-4fd4-b498-ab4bc9f626ba None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.446819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee5f83-d43d-4e35-bf28-dbfb63bcd60f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:57.448748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee5f83-d43d-4e35-bf28-dbfb63bcd60f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:57.469295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 375/750] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 16:59:57 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:59:57.470626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee5f83-d43d-4e35-bf28-dbfb63bcd60f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:57.497254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.498119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.498400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.498675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.506969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:57.508481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:57.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:57.526093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 16:59:57.527061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:57.530051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 376/751] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 16:59:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:57.532716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:57.593910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:57.652616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b776f-cb33-4511-8d1d-17fc3758024e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.694031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36743ce8-3672-4071-b10b-550bfa53a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.694761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743ce8-3672-4071-b10b-550bfa53a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.695043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743ce8-3672-4071-b10b-550bfa53a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.695320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743ce8-3672-4071-b10b-550bfa53a4e2 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.696264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36743ce8-3672-4071-b10b-550bfa53a4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:57.697050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36743ce8-3672-4071-b10b-550bfa53a4e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:57.698250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36743ce8-3672-4071-b10b-550bfa53a4e2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:57.718454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 377/752] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 23 16:59:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:57.720179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041871-f0bf-44b7-9962-4a6517575c87 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.720470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041871-f0bf-44b7-9962-4a6517575c87 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.720744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041871-f0bf-44b7-9962-4a6517575c87 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.722370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 378/753] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:57.727649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf60cd-cd6a-4402-b55f-34f158165dd0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.728054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf60cd-cd6a-4402-b55f-34f158165dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.728428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf60cd-cd6a-4402-b55f-34f158165dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.734853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee5f83-d43d-4e35-bf28-dbfb63bcd60f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.748908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c3cf60cd-cd6a-4402-b55f-34f158165dd0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:57.750173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c3cf60cd-cd6a-4402-b55f-34f158165dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:57.779702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.780775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.781438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.782344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.783526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:57.783983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:57.785745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:57.804556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 376/754] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:57.806534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:57.830971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 379/755] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 16:59:57.831943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf60cd-cd6a-4402-b55f-34f158165dd0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:57.837841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:57.898698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:57.920601 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d5b52-e5b9-46bb-adf7-0db657034ef1 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.959539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf60cd-cd6a-4402-b55f-34f158165dd0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:57.959926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1354ddd-bac3-420d-94e2-48b3f00df967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.960818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1354ddd-bac3-420d-94e2-48b3f00df967 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.961348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1354ddd-bac3-420d-94e2-48b3f00df967 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.961946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1354ddd-bac3-420d-94e2-48b3f00df967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:57.995909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:57.996854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:57.997144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:57.997460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.005298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.006795 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 16:59:58.022575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:58.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 380/756] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 16:59:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:58.025108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.042564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1354ddd-bac3-420d-94e2-48b3f00df967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.044033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1354ddd-bac3-420d-94e2-48b3f00df967 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.068167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:58.156305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 377/757] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 16:59:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 16:59:58.157098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1354ddd-bac3-420d-94e2-48b3f00df967 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.166342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:58.170537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0637e-143b-4f7c-88e0-9c6aa608bcea None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.212615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.213684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.214005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.214283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.214976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.216759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:58.234316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:58.235573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 16:59:58.236600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:58.240666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 381/758] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:58.241531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.276375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1354ddd-bac3-420d-94e2-48b3f00df967 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.301241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:58.315336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.316383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.316935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.317399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.318464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:58.319319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.322058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.341843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 378/759] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:58.343102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.362073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6fc02-be84-4e5f-b003-73c549510070 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.403551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.404983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.405692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.406636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.422847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.424889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:58.447027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:58.448060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:58.449005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:58.449005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:58.449005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:58.449005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:58.453257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 382/760] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:58.454115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.471463 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06fc94-ae56-4a00-871c-0d6fab7ed942 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.472666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:58.511199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.512367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.512974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.513476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.514433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:58.515030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.516759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.522066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 379/761] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:58.523232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.557678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d60f-4f1c-40de-a929-f53ac590ecdc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.573126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:58.591625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.592424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.592702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.592970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.604236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.605697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 16:59:58.622843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:58.623982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:58.625016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 16:59:58.625016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 16:59:58.625016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 16:59:58.625016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:58.625016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 383/762] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:58.625308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.637991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ecc0-f7bf-4d10-8042-2c13dd352ffc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.675578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.676702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.677371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.677922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.678808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:58.679259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.681069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.694415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 380/763] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:58.695472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.707443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:58.743468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc441f-61ed-48be-914a-8e5a20de640c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.778840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.779537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.779817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.780092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.780947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:58.781256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.782676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.793892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 384/764] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:58.794827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.813672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557974-9591-4e23-a013-3f99e9b65870 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.816499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:58.854233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.855257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.855734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.856151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.857236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:58.857686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.859233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.873116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 381/765] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:58.874379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.895439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe166a-3bc5-4f10-90a6-3c604ad7140c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:58.924538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:58.930050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:58.931199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:58.931892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:58.932455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:58.939836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:58.941414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:58.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:58.957761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:58.958703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:58.958703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:58.958703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:58.958703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:58.958703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:58.958703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:58.958703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:58.958703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:58.963350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 385/766] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:58.964620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:58.992231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028e48c-ca58-4ede-8a75-d8a5ee226717 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:59.030242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:59.031304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.031790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.032284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.033396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] RBAC: Adding query filter params (interface=public, service_id=c70bf43b22e14eb6a930a42b30d83d69, region_id=RegionOne) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:59.034037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:59.035669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:59.044178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 382/767] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/endpoints?service_id=c70bf43b22e14eb6a930a42b30d83d69&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:59.045333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:59.068405 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba2540-4775-4b6f-8fac-50f830c6402b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:59.076604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:59.103172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:59.104161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.104275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.104504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.111458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:59.112927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 16:59:59.127032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:59.127981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:59.128877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 386/768] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 16:59:59.129646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:59.162472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ab55b-4e82-4d64-9f4d-4a2113da6862 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:59.185180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:59.207279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:59.208343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.208843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.209360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.210460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:59.211531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:59.213645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:59.231775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 383/769] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:59.232970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:59.241570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5154e9-1a0d-41e3-985f-dd2f62f7d9ae None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:59.276586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326b66-18f7-47f8-bcc6-fbbbdb7e8f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:59.277285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326b66-18f7-47f8-bcc6-fbbbdb7e8f9b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.277563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326b66-18f7-47f8-bcc6-fbbbdb7e8f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.277864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326b66-18f7-47f8-bcc6-fbbbdb7e8f9b None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.278549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18326b66-18f7-47f8-bcc6-fbbbdb7e8f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:59.279927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18326b66-18f7-47f8-bcc6-fbbbdb7e8f9b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:59.291045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 387/770] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 16:59:59 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:59.292425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326b66-18f7-47f8-bcc6-fbbbdb7e8f9b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:59.352320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:59.371272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a648c5-0ed4-4642-a61d-55d43461ac6c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:59.421124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13013-223d-4a67-a68c-82b0a2f58ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:59.422364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13013-223d-4a67-a68c-82b0a2f58ade None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.422820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13013-223d-4a67-a68c-82b0a2f58ade None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.423654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13013-223d-4a67-a68c-82b0a2f58ade None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.424887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13013-223d-4a67-a68c-82b0a2f58ade None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:59.425373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13013-223d-4a67-a68c-82b0a2f58ade None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:59.426463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326b66-18f7-47f8-bcc6-fbbbdb7e8f9b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:59.427464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13013-223d-4a67-a68c-82b0a2f58ade None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:59.446748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:59.452301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 384/771] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 16:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:59.454452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48eac0-140c-44f7-93f4-a54486de7bd7 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.454896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48eac0-140c-44f7-93f4-a54486de7bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.455319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48eac0-140c-44f7-93f4-a54486de7bd7 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.457487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 385/772] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 16:59:59.458387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48eac0-140c-44f7-93f4-a54486de7bd7 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:59.474314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8a9b9-cdca-42fe-bc44-4c8c80f86522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:59.474975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8a9b9-cdca-42fe-bc44-4c8c80f86522 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.475253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8a9b9-cdca-42fe-bc44-4c8c80f86522 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.475526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8a9b9-cdca-42fe-bc44-4c8c80f86522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.476360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8a9b9-cdca-42fe-bc44-4c8c80f86522 None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=faa0343291164cbc9f9ca0aa754ecad3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:59:59.476719 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8a9b9-cdca-42fe-bc44-4c8c80f86522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:59.479102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8a9b9-cdca-42fe-bc44-4c8c80f86522 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:59.487962 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 388/773] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 16:59:59 2022] GET /identity/v3/role_assignments?user.id=faa0343291164cbc9f9ca0aa754ecad3&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:59:59.488192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056152e-39ac-496b-bcd4-e5734f38ac0d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.488782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056152e-39ac-496b-bcd4-e5734f38ac0d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.488912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056152e-39ac-496b-bcd4-e5734f38ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.510366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6056152e-39ac-496b-bcd4-e5734f38ac0d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:59.511621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6056152e-39ac-496b-bcd4-e5734f38ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:59.600325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48eac0-140c-44f7-93f4-a54486de7bd7 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:59.624723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 389/774] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 16:59:59.648239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056152e-39ac-496b-bcd4-e5734f38ac0d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:59.650726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98496e60-f6a0-4f32-8edd-cd9fcf228e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:59.651897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496e60-f6a0-4f32-8edd-cd9fcf228e8a None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.653103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496e60-f6a0-4f32-8edd-cd9fcf228e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.653381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496e60-f6a0-4f32-8edd-cd9fcf228e8a None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/10b3274005534830b0768b122769dd1a/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.655674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496e60-f6a0-4f32-8edd-cd9fcf228e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=10b3274005534830b0768b122769dd1a, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:59:59.657119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98496e60-f6a0-4f32-8edd-cd9fcf228e8a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:59:59.698957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 386/775] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 16:59:59 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/10b3274005534830b0768b122769dd1a/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:59:59.748958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a031ff7-ba3e-4102-be1e-fe38a3bee79a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.748958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a031ff7-ba3e-4102-be1e-fe38a3bee79a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.749451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a031ff7-ba3e-4102-be1e-fe38a3bee79a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.751027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 387/776] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 16:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 16:59:59.756565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51982e22-1d43-48c0-88d0-75f397a11782 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.756970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51982e22-1d43-48c0-88d0-75f397a11782 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.758062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51982e22-1d43-48c0-88d0-75f397a11782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.791871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-51982e22-1d43-48c0-88d0-75f397a11782 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:59:59.793291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-51982e22-1d43-48c0-88d0-75f397a11782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:59:59.794238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056152e-39ac-496b-bcd4-e5734f38ac0d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:59:59.795782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:59.815178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:59:59.862097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508001-4389-4f91-b385-3b27a7686c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:59:59.862097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508001-4389-4f91-b385-3b27a7686c2e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:59:59.862097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508001-4389-4f91-b385-3b27a7686c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:59:59.862097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508001-4389-4f91-b385-3b27a7686c2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:59:59.877942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91508001-4389-4f91-b385-3b27a7686c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-91508001-4389-4f91-b385-3b27a7686c2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 16:59:59.885818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 16:59:59.886816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 16:59:59.887667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 390/777] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 16:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 16:59:59.890427 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508001-4389-4f91-b385-3b27a7686c2e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:59:59.913642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 388/778] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 16:59:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 16:59:59.935844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51982e22-1d43-48c0-88d0-75f397a11782 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:00.007138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508001-4389-4f91-b385-3b27a7686c2e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:00.042524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:00.043199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:00.043481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:00.043754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:00.044506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:00.044811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:00.046226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:00.055228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 391/779] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 16:59:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:00.061389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:00.070678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51982e22-1d43-48c0-88d0-75f397a11782 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:00.104165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:00.154557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:00.155387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:00.155669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:00.155945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] PATH_INFO: `/v3/services/network` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:00.156619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:00.158056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:00.177620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48371de3-fe89-4fef-8c33-f764ed18fa93 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:00.182769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:00.184063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:00.184920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 389/780] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 16:59:59 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:00.189922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:00.196053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:00.215669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:00.216889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:00.217315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:00.217757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:00.242727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:00.245099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:00.277018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:00.277980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:00.278899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:00.278899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:00.278899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:00.278899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:00.282039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 392/781] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:00.288831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:00.391800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2970-377d-45c8-ba3b-610527c37b06 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:00.398142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:00.426094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40b1a2-7f7a-4b45-b593-e48bfd8649ce None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:00.462683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:00.463357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:00.463634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:00.463900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:00.464625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] RBAC: Adding query filter params (name=network) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:00.464927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:00.466332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:00.477733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 390/782] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:00.484876 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:00.500101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:00.500821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:00.501101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:00.501374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:00.502193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:00.502497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:00.503864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:00.527725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 393/783] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:00.534848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:00.610403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:00.673057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72da5d-cc97-4a55-bb7f-f7c126f1117d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:00.717058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0ec6-068b-4813-b886-767254a031bb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:00.739942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:00.740613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:00.740893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:00.741164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:00.741902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] RBAC: Adding query filter params (type=network) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:00.742206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:00.743584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:00.756631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 391/784] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:00.764241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:00.786347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:00.787065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:00.787344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:00.787617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:00.800288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:00.803027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:00.829429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:00.830504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 17:00:00.831472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:00.836510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 394/785] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:00:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:00.843859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:00.850911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:00.937398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2221998-8082-454d-9386-7f08a3500dfa None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:00.965854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:00.995063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:00.995788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:00.996077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:00.996356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:00.997163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] RBAC: Adding query filter params (interface=public, service_id=247d836d0c8c45b391d6f09999653edf, region_id=RegionOne) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:00.997478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:00.998957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:01.000178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a5abc-8740-4d08-a633-6eaa28f44f33 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:01.016344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 392/786] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 23 17:00:00 2022] GET /identity/v3/endpoints?service_id=247d836d0c8c45b391d6f09999653edf&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:01.021962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:01.037819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:01.038441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.038729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.038997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.039846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:01.040155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:01.041715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:01.060515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 395/787] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 23 17:00:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:01.069160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:01.177583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:01.210834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03731-bf33-43e3-883d-5eae67f685e6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:01.247801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a6df6-3c6a-4ede-92b3-41a4bb04f243 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:01.270742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb988834-d504-4241-9589-47c93eaf69a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:01.271430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988834-d504-4241-9589-47c93eaf69a7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.271685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988834-d504-4241-9589-47c93eaf69a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.272029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988834-d504-4241-9589-47c93eaf69a7 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.272726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb988834-d504-4241-9589-47c93eaf69a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:01.274202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb988834-d504-4241-9589-47c93eaf69a7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:01.286190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 393/788] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 17:00:01 2022] GET /identity/v3/services => generated 772 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:01.317554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:01.318378 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.318662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.318934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.338943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:01.340485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:01.369518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:01.371705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:01.373765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:01.373765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:01.373765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:01.373765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:01.373765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 396/789] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:01.376527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb988834-d504-4241-9589-47c93eaf69a7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:01.480368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:01.535766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb988834-d504-4241-9589-47c93eaf69a7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:01.576154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:01.576753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.577397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.577672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.578446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:01.578752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:01.580144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:01.595589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 394/790] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:01.600858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:01.711882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffddcb-99b8-4c9a-bf65-97eddc0a0bf0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:01.726827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:01.748617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b005f5b-fef7-4ed6-8716-154c360fe698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:01.749425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005f5b-fef7-4ed6-8716-154c360fe698 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.749706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005f5b-fef7-4ed6-8716-154c360fe698 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.750010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b005f5b-fef7-4ed6-8716-154c360fe698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.757437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b005f5b-fef7-4ed6-8716-154c360fe698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:01.758995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b005f5b-fef7-4ed6-8716-154c360fe698 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7b005f5b-fef7-4ed6-8716-154c360fe698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:01.773009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:01.774886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:01.775978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 397/791] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:01.782940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:01.829176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ef3ee-f1e7-49bc-932c-603ca67aeda9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.829482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ef3ee-f1e7-49bc-932c-603ca67aeda9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.829650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ef3ee-f1e7-49bc-932c-603ca67aeda9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.831169 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 398/792] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:00:01.836879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1007b-54db-4552-86d8-f9853c49d2db None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.837464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1007b-54db-4552-86d8-f9853c49d2db None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.837980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1007b-54db-4552-86d8-f9853c49d2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.860798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ecb1007b-54db-4552-86d8-f9853c49d2db None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:01.862942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ecb1007b-54db-4552-86d8-f9853c49d2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:01.902869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979dc12-b074-470a-8a9b-942feb4ee5fc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:01.931312 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:01.950238 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:01.951000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.951350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.951694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.952977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:01.953354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:01.954957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:01.966440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 399/793] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 23 17:00:01.967810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e9416-c555-4371-b949-603edd2a27e3 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.968099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e9416-c555-4371-b949-603edd2a27e3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.968377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e9416-c555-4371-b949-603edd2a27e3 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:01.968484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 395/794] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:01.969637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 400/795] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:01.973786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:01.982811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcac58-0d61-4b95-83b5-01a962feb913 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:01.983104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcac58-0d61-4b95-83b5-01a962feb913 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:01.983380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcac58-0d61-4b95-83b5-01a962feb913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.005032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c9bcac58-0d61-4b95-83b5-01a962feb913 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:02.006614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c9bcac58-0d61-4b95-83b5-01a962feb913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:02.094413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 401/796] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:02.095172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30e03c-d46b-468c-befa-527e832a65c8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:02.096221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcac58-0d61-4b95-83b5-01a962feb913 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.129910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60066f-16f4-4b82-b418-e4fdfe5f6ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:02.130784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60066f-16f4-4b82-b418-e4fdfe5f6ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.131092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60066f-16f4-4b82-b418-e4fdfe5f6ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.131384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60066f-16f4-4b82-b418-e4fdfe5f6ea4 None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/08ffc7cdb0d54083bbedaa3e7441e099/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.133330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60066f-16f4-4b82-b418-e4fdfe5f6ea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=08ffc7cdb0d54083bbedaa3e7441e099, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:02.134847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60066f-16f4-4b82-b418-e4fdfe5f6ea4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:02.141549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:02.153086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 396/797] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:00:01 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/08ffc7cdb0d54083bbedaa3e7441e099/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:00:02.154470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60066f-16f4-4b82-b418-e4fdfe5f6ea4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.215781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:02.222558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcac58-0d61-4b95-83b5-01a962feb913 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:02.266285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba66665-5421-464c-8b26-b14e789850b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:02.267658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66665-5421-464c-8b26-b14e789850b1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.268153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66665-5421-464c-8b26-b14e789850b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.268625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66665-5421-464c-8b26-b14e789850b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.281992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba66665-5421-464c-8b26-b14e789850b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:02.283827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60066f-16f4-4b82-b418-e4fdfe5f6ea4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fba66665-5421-464c-8b26-b14e789850b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:02.291203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:02.292249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:00:02.293099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:02.296203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 402/798] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:02.297983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39696f5-7690-44ba-b7ce-51555da09222 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.298506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39696f5-7690-44ba-b7ce-51555da09222 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.298977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39696f5-7690-44ba-b7ce-51555da09222 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.301005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 403/799] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:02.302029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39696f5-7690-44ba-b7ce-51555da09222 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.332040 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc91cf-b65f-4edc-9be6-8bcc912a55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:02.333428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc91cf-b65f-4edc-9be6-8bcc912a55a7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.333716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc91cf-b65f-4edc-9be6-8bcc912a55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.334171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc91cf-b65f-4edc-9be6-8bcc912a55a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.335868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc91cf-b65f-4edc-9be6-8bcc912a55a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:02.336550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc91cf-b65f-4edc-9be6-8bcc912a55a7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-93fc91cf-b65f-4edc-9be6-8bcc912a55a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:02.351889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:02.352850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:02.353703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 397/800] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:02.356492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6346-13a2-4dcc-a214-cf919b1ddff0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.356780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6346-13a2-4dcc-a214-cf919b1ddff0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.357066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6346-13a2-4dcc-a214-cf919b1ddff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.374509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-3bae6346-13a2-4dcc-a214-cf919b1ddff0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:02.375725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-3bae6346-13a2-4dcc-a214-cf919b1ddff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:02.419260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:02.434568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39696f5-7690-44ba-b7ce-51555da09222 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:02.458870 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 398/801] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:02.460063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae6346-13a2-4dcc-a214-cf919b1ddff0 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.500311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:02.501003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.501296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.501571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.502621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:02.502940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:02.505072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:02.510120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:02.517483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 404/802] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:02.518465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.604273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae6346-13a2-4dcc-a214-cf919b1ddff0 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:02.630035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab3bd-af79-434d-9382-c623b9b2392a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:02.652043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:02.652726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.653010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.653287 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.654293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:02.654604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:02.656838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:02.664325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 399/803] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:02.665360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.671479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d942-d09f-4de2-82d1-baa25278d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:02.672598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d942-d09f-4de2-82d1-baa25278d9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.673080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d942-d09f-4de2-82d1-baa25278d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.673549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d942-d09f-4de2-82d1-baa25278d9e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.686055 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0d942-d09f-4de2-82d1-baa25278d9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-42b0d942-d09f-4de2-82d1-baa25278d9e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:02.697350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:02.698329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:02.699205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:02.702364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 405/804] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:02.703491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d942-d09f-4de2-82d1-baa25278d9e9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.727648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:02.789187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:02.796107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc6aa1-3b3c-496a-af19-92a6706444b5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:02.834082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:02.834996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.835284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.835655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.845290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d942-d09f-4de2-82d1-baa25278d9e9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:02.846440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:02.848167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:02.867541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:02.868475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:02.869366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:02.869366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:02.869366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:02.869366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:02.873495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 400/805] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:02.874533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.882661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:02.883339 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:02.883618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:02.884316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:02.885039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:02.885344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:02.886752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:02.893834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 406/806] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:02.894684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:02.978894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:02.987181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4eff0-af2f-4075-af60-1d00c1524997 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.006594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7030cf-b248-4a2a-aab7-3780adcdc640 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.025928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.027009 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.027529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.027947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.028841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:03.029305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.031024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.045341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.045341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.045341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.045341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.045849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 401/807] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:03.046469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:03.046946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.047109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.049127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.060901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:03.067017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 407/808] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:03.067017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.162539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeab63-68f4-46f3-bc21-ca595d74fd60 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.163188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87376c7d-953f-4f81-9b9f-63556ae3948b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.196634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.197445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.197726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.198027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.200429 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a5d8-649f-4b58-933c-091c35e7ef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.201353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a5d8-649f-4b58-933c-091c35e7ef84 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.202120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a5d8-649f-4b58-933c-091c35e7ef84 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.202536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a5d8-649f-4b58-933c-091c35e7ef84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.203771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a5d8-649f-4b58-933c-091c35e7ef84 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.205392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a5d8-649f-4b58-933c-091c35e7ef84 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.209178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:03.212020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.213245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.232613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 402/809] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:00:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:03.233209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:03.234341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:03.235401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:03.235401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:03.235401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:03.235401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:03.236642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a5d8-649f-4b58-933c-091c35e7ef84 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.239423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 408/810] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:03.240576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.313413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:03.358347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5335e-7f8c-44d3-b758-09f40a792323 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.361265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a5d8-649f-4b58-933c-091c35e7ef84 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.398809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.399487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.399780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.400131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.400819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.400949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:03.401158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.402124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.402545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.402657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.403049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.411495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.413351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.415891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 409/811] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:03.421674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:03.431579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:03.432791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:03.433824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:03.436195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 403/812] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:03.442523 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.483654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:03.545100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019348-943c-4081-8531-1ecbe02c6477 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.586596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.587452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.587739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.587988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038f297-b8ba-4964-bcb8-8954e31e44a5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.588196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.597896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.599462 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.615050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:03.617057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:03.618706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:03.620009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 410/813] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:03.624624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.632339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.633242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.633700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.634146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.635138 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:03.636217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.637860 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.663622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 404/814] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:03.669382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.777137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67f28e-f852-478d-8649-82b4c3d75f87 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.791109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:03.793910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662263f7-a7e0-4903-9105-5ce4ffef12fb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.818071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222057f-25f9-478f-a562-091cce217b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.818919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222057f-25f9-478f-a562-091cce217b4e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.819315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222057f-25f9-478f-a562-091cce217b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.819682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222057f-25f9-478f-a562-091cce217b4e None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.820621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222057f-25f9-478f-a562-091cce217b4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:03.821355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222057f-25f9-478f-a562-091cce217b4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.822572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222057f-25f9-478f-a562-091cce217b4e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.845822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 411/815] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:03.845822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bf19-1bfd-4b4f-a684-17d8dc332461 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.845822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bf19-1bfd-4b4f-a684-17d8dc332461 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.845822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bf19-1bfd-4b4f-a684-17d8dc332461 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.845822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 412/816] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:03.849966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59bf19-1bfd-4b4f-a684-17d8dc332461 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:03.851924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66813385-31ba-4df0-b409-ac79a0570761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:03.852818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66813385-31ba-4df0-b409-ac79a0570761 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.853156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66813385-31ba-4df0-b409-ac79a0570761 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.853599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66813385-31ba-4df0-b409-ac79a0570761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.864500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66813385-31ba-4df0-b409-ac79a0570761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:03.866241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66813385-31ba-4df0-b409-ac79a0570761 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-66813385-31ba-4df0-b409-ac79a0570761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:03.884052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:03.884988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:03.885944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:03.885944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:03.885944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:03.885944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:03.885944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 405/817] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:03.891614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2538-4d07-4554-8be8-61a8ead67830 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:03.891894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2538-4d07-4554-8be8-61a8ead67830 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:03.892163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f2538-4d07-4554-8be8-61a8ead67830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:03.909153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-149f2538-4d07-4554-8be8-61a8ead67830 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:03.910448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-149f2538-4d07-4554-8be8-61a8ead67830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:03.942471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:03.968413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59bf19-1bfd-4b4f-a684-17d8dc332461 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:03.990155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 406/818] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:03.991292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f2538-4d07-4554-8be8-61a8ead67830 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.020006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4562-f52c-46ee-91d1-e87ed5339694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.021072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4562-f52c-46ee-91d1-e87ed5339694 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.021484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4562-f52c-46ee-91d1-e87ed5339694 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.022009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4562-f52c-46ee-91d1-e87ed5339694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.084291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:04.101368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f2538-4d07-4554-8be8-61a8ead67830 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:04.124526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb4562-f52c-46ee-91d1-e87ed5339694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.126068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb4562-f52c-46ee-91d1-e87ed5339694 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.139371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.140450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.140908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.141404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.142350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:04.142830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.144624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.157997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 407/819] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:04.159258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.186120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:04.236512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 413/820] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:00:04.236512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4562-f52c-46ee-91d1-e87ed5339694 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.276623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9cb81-1b73-4a73-a1f5-a0517bb1cf16 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:04.301974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:04.317016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.318278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.318803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.319255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] PATH_INFO: `/v3/services/network` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.320095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.321758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.333980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4562-f52c-46ee-91d1-e87ed5339694 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:04.335384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:04.336448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 17:00:04.337323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:04.339821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 408/821] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:04 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:04.340766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.374235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.375102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.375515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.375634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.384390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.387581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:04.403511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:04.404665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:04.405714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:04.405714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:04.405714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:04.405714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:04.405714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:04.405714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:04.405714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:04.405714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:04.409820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 414/822] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:04.410886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.456882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:04.472962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71658335-528d-4e80-a055-c658a2df2821 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:04.508057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.508743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.509021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.509347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.520503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.521984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.540905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfae96-b81a-40ce-9579-bf4b8d7c7199 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:04.541683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:04.542699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:04.543610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:04.543610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:04.543610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:04.543610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:04.544279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 409/823] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:04.544915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.573406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:04.580849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8a254-96bf-4293-a7fa-6b892577beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.581517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a254-96bf-4293-a7fa-6b892577beae None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.581825 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a254-96bf-4293-a7fa-6b892577beae None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.582194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a254-96bf-4293-a7fa-6b892577beae None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.582972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8a254-96bf-4293-a7fa-6b892577beae None admin] RBAC: Adding query filter params (name=network) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:04.583373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8a254-96bf-4293-a7fa-6b892577beae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.585010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8a254-96bf-4293-a7fa-6b892577beae None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.589517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 415/824] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:04.590759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b23c-7849-4fac-939a-749b98733d72 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.591047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b23c-7849-4fac-939a-749b98733d72 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.591320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0b23c-7849-4fac-939a-749b98733d72 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.592642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 416/825] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:04.597311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b23c-7849-4fac-939a-749b98733d72 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.660613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc93fdc-dc42-4f74-a3c5-97471410b1fe None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:04.696823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.697493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.697774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.698068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.698859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:04.699165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.700604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.708418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:04.714680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 410/826] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:04.715533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.731578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0b23c-7849-4fac-939a-749b98733d72 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:04.770756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3e05a-8665-4043-b628-e0ff9517c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.771468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3e05a-8665-4043-b628-e0ff9517c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.771749 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3e05a-8665-4043-b628-e0ff9517c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.772021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3e05a-8665-4043-b628-e0ff9517c7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.772742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3e05a-8665-4043-b628-e0ff9517c7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:04.773056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3e05a-8665-4043-b628-e0ff9517c7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.774439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3e05a-8665-4043-b628-e0ff9517c7a0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.791704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 417/827] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:04.791704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc601308-73e4-4c59-a3b3-4f87912bd23b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.791704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc601308-73e4-4c59-a3b3-4f87912bd23b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.791704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc601308-73e4-4c59-a3b3-4f87912bd23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.807588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fc601308-73e4-4c59-a3b3-4f87912bd23b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:04.808535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fc601308-73e4-4c59-a3b3-4f87912bd23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:04.837114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b305850-87ff-46de-abe3-f490eef3afce None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:04.864222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:04.874717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:04.875448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:04.875649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:04.875919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:04.876622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] RBAC: Adding query filter params (type=network) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:04.876923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:04.878329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:04.883268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 418/828] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:04.883890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc601308-73e4-4c59-a3b3-4f87912bd23b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.898550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 411/829] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:04.898550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:04.964938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:04.996220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc601308-73e4-4c59-a3b3-4f87912bd23b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.004757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b0ad2-d59a-4824-ab7b-7a1bcfc16206 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.031377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad2351-f04f-4e3e-9b96-7cdce9779b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.032280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2351-f04f-4e3e-9b96-7cdce9779b2a None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.032578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2351-f04f-4e3e-9b96-7cdce9779b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.032835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2351-f04f-4e3e-9b96-7cdce9779b2a None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/faa0343291164cbc9f9ca0aa754ecad3/roles/e113a817a4414021ba3aab63aadc0c22` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.041658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.042512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.042785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.043060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.047602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad2351-f04f-4e3e-9b96-7cdce9779b2a None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=faa0343291164cbc9f9ca0aa754ecad3, role_id=e113a817a4414021ba3aab63aadc0c22)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:05.049089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad2351-f04f-4e3e-9b96-7cdce9779b2a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:05.050015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:05.051576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:05.067907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 419/830] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:00:04 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/faa0343291164cbc9f9ca0aa754ecad3/roles/e113a817a4414021ba3aab63aadc0c22 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:00:05.067907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad2351-f04f-4e3e-9b96-7cdce9779b2a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:05.068171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:05.069030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 412/831] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:05.072324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:05.116802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:05.209144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad2351-f04f-4e3e-9b96-7cdce9779b2a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.221949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d626fa1-ad2d-4cd1-b537-cb2c7cebae56 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.251763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8de21-0ddd-4740-8604-45607d820636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.252451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8de21-0ddd-4740-8604-45607d820636 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.252694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8de21-0ddd-4740-8604-45607d820636 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.252970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8de21-0ddd-4740-8604-45607d820636 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.253725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8de21-0ddd-4740-8604-45607d820636 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:05.254268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:05.257134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8de21-0ddd-4740-8604-45607d820636 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:05.271324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6ec35-87a8-464a-897b-4424d5cbfa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.272138 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6ec35-87a8-464a-897b-4424d5cbfa1b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.272416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6ec35-87a8-464a-897b-4424d5cbfa1b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.272684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6ec35-87a8-464a-897b-4424d5cbfa1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 420/832] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:00:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:05.283165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8de21-0ddd-4740-8604-45607d820636 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:05.286404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6ec35-87a8-464a-897b-4424d5cbfa1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-2bb6ec35-87a8-464a-897b-4424d5cbfa1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:05.294890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:05.295939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:05.296835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 413/833] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:05.304260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6ec35-87a8-464a-897b-4424d5cbfa1b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:05.444077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6ec35-87a8-464a-897b-4424d5cbfa1b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.465363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:05.499626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8de21-0ddd-4740-8604-45607d820636 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.500493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.501286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.503154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.503525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.504424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:05.506287 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:05.507054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:05.524582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 414/834] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:00:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:05.526298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:05.551627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.552647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.553130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.553607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.554711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:05.555025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:05.556560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:05.570954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 421/835] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:05.577168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:05.579843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:05.648702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724b749-6321-4793-836f-56bc2bd9c189 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.688857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f1b7f-58bf-49a3-96b6-f107f0c3c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.689683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1b7f-58bf-49a3-96b6-f107f0c3c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.689996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1b7f-58bf-49a3-96b6-f107f0c3c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.691026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1b7f-58bf-49a3-96b6-f107f0c3c9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.704279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051327b-db1e-4b4e-92cd-e0558b170d85 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.710537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f1b7f-58bf-49a3-96b6-f107f0c3c9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:05.712131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f1b7f-58bf-49a3-96b6-f107f0c3c9d0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-266f1b7f-58bf-49a3-96b6-f107f0c3c9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:05.740079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:05.741038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:05.742386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:05.742386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:05.742386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:05.742386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:05.745292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6387f-1f93-411b-9590-bd3df46f8a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.745924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 415/836] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:05.746043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6387f-1f93-411b-9590-bd3df46f8a02 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.746267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6387f-1f93-411b-9590-bd3df46f8a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.746545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6387f-1f93-411b-9590-bd3df46f8a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.747384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6387f-1f93-411b-9590-bd3df46f8a02 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=10b3274005534830b0768b122769dd1a) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:05.747693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6387f-1f93-411b-9590-bd3df46f8a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:05.747801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7dc9-2f6a-4929-bd60-aa5c1d235fa8 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.747996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7dc9-2f6a-4929-bd60-aa5c1d235fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.748272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7dc9-2f6a-4929-bd60-aa5c1d235fa8 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.749121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6387f-1f93-411b-9590-bd3df46f8a02 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:05.749736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 416/837] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:05.754352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf7dc9-2f6a-4929-bd60-aa5c1d235fa8 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:05.756685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 422/838] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:05 2022] GET /identity/v3/role_assignments?user.id=10b3274005534830b0768b122769dd1a&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:05.756799 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c39ad1-6b9a-411c-a786-ce00cb140cce None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.759251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c39ad1-6b9a-411c-a786-ce00cb140cce None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.759251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c39ad1-6b9a-411c-a786-ce00cb140cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.775948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c7c39ad1-6b9a-411c-a786-ce00cb140cce None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:05.777262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c7c39ad1-6b9a-411c-a786-ce00cb140cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:05.796453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:05.860655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:05.872416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf7dc9-2f6a-4929-bd60-aa5c1d235fa8 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:05.879163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 423/839] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:05.901012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c39ad1-6b9a-411c-a786-ce00cb140cce None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:05.915575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:05.916385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:05.916756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:05.917132 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:05.917943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:05.918337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:05.919828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:05.933198 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 417/840] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:05.938809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:06.034160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c39ad1-6b9a-411c-a786-ce00cb140cce None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:06.064105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c0205-3b12-4ac9-aeda-93006e94d106 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:06.082956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:06.084105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:06.084583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:06.085083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:06.086474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:06.088641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:06.099979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:06.100796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:06.101079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:06.101426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:06.106261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:06.107256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:06.108125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:06.110519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:06.111199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 424/841] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:06.114732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:06.117311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:06.129181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:06.137960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:06.138926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:06.139888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 418/842] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:00:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:06.146768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:06.170560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:06.231334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd89c9b-71cc-4f52-9ce1-a23bbcf5ebd0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:06.270818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:06.272301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:06.272741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c816610-9404-4a16-a8b7-30516944bc3b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:06.272999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:06.273489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:06.274543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:06.275173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:06.276624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:06.282468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 425/843] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:06.287431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:06.311839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:06.313311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:06.314182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:06.314536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:06.315631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:06.316013 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:06.318341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:06.345851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 419/844] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jun 23 17:00:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:06.351175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:06.371314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:06.406903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179e2b0-32b3-4027-be2f-7b1394dc9899 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:06.435230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:06.459207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:06.459879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:06.460155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:06.460424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:06.461138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:06.461437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:06.463052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:06.473833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 426/845] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:06.486344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06327e6-be00-4b5f-a8ee-293f0d996c76 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:06.524926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b1246-b533-4dbe-a2fb-644e68ca77eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:06.525583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b1246-b533-4dbe-a2fb-644e68ca77eb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:06.525924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b1246-b533-4dbe-a2fb-644e68ca77eb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:06.526200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b1246-b533-4dbe-a2fb-644e68ca77eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:06.610733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b1246-b533-4dbe-a2fb-644e68ca77eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:06.612209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b1246-b533-4dbe-a2fb-644e68ca77eb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:06.688487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:06.726390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 420/846] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 17:00:06.731959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:06.837648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d1d9-9c4d-4476-bda5-1d6cd1c0f7a4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:06.874881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:06.876069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:06.876551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:06.877054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:06.880129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:06.889128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:06.890988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:06.909385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:06.910583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:06.911613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:06.911613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:06.911613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:06.911613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:06.917906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 427/847] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:06.919774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b1246-b533-4dbe-a2fb-644e68ca77eb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:07.024123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b1246-b533-4dbe-a2fb-644e68ca77eb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:07.059524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:07.060578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.061059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.061527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.062472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:07.062972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:07.064556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:07.078361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 421/848] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:07.084771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:07.192780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c1240-2992-4155-a054-cfe1739223ed None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:07.228359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843440a-deb5-4bc6-930d-698388731039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:07.229544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843440a-deb5-4bc6-930d-698388731039 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.230063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843440a-deb5-4bc6-930d-698388731039 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.230534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843440a-deb5-4bc6-930d-698388731039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.238347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843440a-deb5-4bc6-930d-698388731039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:07.240156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843440a-deb5-4bc6-930d-698388731039 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1843440a-deb5-4bc6-930d-698388731039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:07.255228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:07.256149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:07.257067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:07.257067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:07.257067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:07.257067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:07.257067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:07.257067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:07.257067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:07.257067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:07.259513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 428/849] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:07.265435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:07.274441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7160-7d46-4dd7-ba13-5be81fc4506a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.274940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7160-7d46-4dd7-ba13-5be81fc4506a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.274940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7160-7d46-4dd7-ba13-5be81fc4506a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.276634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 429/850] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:00:07.281608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b66df-a79e-4cd2-8019-9b1bfbb7764f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.281924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b66df-a79e-4cd2-8019-9b1bfbb7764f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.282207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b66df-a79e-4cd2-8019-9b1bfbb7764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.299475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a84b66df-a79e-4cd2-8019-9b1bfbb7764f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:07.300706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a84b66df-a79e-4cd2-8019-9b1bfbb7764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:07.318186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:07.349822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:07.382145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 430/851] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:07.393186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8409a9-c5a2-40af-871f-515529301176 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:07.399081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b66df-a79e-4cd2-8019-9b1bfbb7764f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:07.438164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:07.439199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.440182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.440657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.442294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:07.443074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:07.445912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:07.469867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 422/852] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:07.473511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:07.524953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b66df-a79e-4cd2-8019-9b1bfbb7764f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:07.564724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc3c9-1344-4dc8-8f37-4eab1c79f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:07.565578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc3c9-1344-4dc8-8f37-4eab1c79f593 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.565889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc3c9-1344-4dc8-8f37-4eab1c79f593 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.566202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc3c9-1344-4dc8-8f37-4eab1c79f593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.577431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc3c9-1344-4dc8-8f37-4eab1c79f593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:07.580701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8d5fc3c9-1344-4dc8-8f37-4eab1c79f593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:07.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:07.587261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:00:07.588138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:07.592593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 431/853] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 17:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:07.593486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc3c9-1344-4dc8-8f37-4eab1c79f593 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:07.595771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a79d3-1aab-4554-b8a5-51b6a8d5588f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:07.633807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:07.634649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.634872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.635151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.636022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=08ffc7cdb0d54083bbedaa3e7441e099) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:07.636361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:07.637773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:07.653888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 423/854] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:07 2022] GET /identity/v3/role_assignments?user.id=08ffc7cdb0d54083bbedaa3e7441e099&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:07.654106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:07.729441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc3c9-1344-4dc8-8f37-4eab1c79f593 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:07.767093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bec0d-92fe-4bec-8ef7-f347f5c54c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:07.768173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bec0d-92fe-4bec-8ef7-f347f5c54c79 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.768677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bec0d-92fe-4bec-8ef7-f347f5c54c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.769160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bec0d-92fe-4bec-8ef7-f347f5c54c79 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.770238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bec0d-92fe-4bec-8ef7-f347f5c54c79 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:07.770752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bec0d-92fe-4bec-8ef7-f347f5c54c79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:07.772367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bec0d-92fe-4bec-8ef7-f347f5c54c79 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:07.782852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 432/855] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 17:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:07.788572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:07.896140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf5ad1-bab5-4e1c-89d6-f614e99cf907 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:07.931038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:07.931911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.932245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.932569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.935494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7778c1-7a31-4dd0-905c-a5d64fe0f07f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.936012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7778c1-7a31-4dd0-905c-a5d64fe0f07f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.936300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7778c1-7a31-4dd0-905c-a5d64fe0f07f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.937678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 433/856] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:00:07.942845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa715ad-97d7-4419-a410-ed028ea1108c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:07.943180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa715ad-97d7-4419-a410-ed028ea1108c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:07.943553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa715ad-97d7-4419-a410-ed028ea1108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:07.948028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:07.949677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:07.962173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3aa715ad-97d7-4419-a410-ed028ea1108c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:07.963428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3aa715ad-97d7-4419-a410-ed028ea1108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:07.968708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:07.969589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:07.970542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:07.970542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:07.970542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:07.970542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:07.972781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 424/857] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:07.978604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:07.988897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:08.094742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e3fbd-0afa-4b63-855c-eced74bffe43 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:08.131923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:08.132890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.133382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.133772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.134673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:08.135075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:08.136773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:08.153900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 425/858] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:08.155872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 434/859] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:08.156786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:08.184744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa715ad-97d7-4419-a410-ed028ea1108c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:08.215932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:08.231133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:08.266260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd24c8-babc-4d01-9ccc-c7e1993b266e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:08.288265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa715ad-97d7-4419-a410-ed028ea1108c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:08.313512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:08.314374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.314793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.315069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.323284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:08.324163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:08.324607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.324607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.325013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.325621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:08.325872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:08.327691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:08.340357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:08.341541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:08.342645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:08.343627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:08.344665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:08.345942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 426/860] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:00:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:08.346677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 435/861] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 23 17:00:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:08.352560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:08.361304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:08.458843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:08.467238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc531e0d-c539-4ad8-a8ef-33c1c772d32a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:08.479105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15d61-7664-41f6-b315-6d59827bfeda None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:08.504712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:08.505756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.506262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.506828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.507930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:08.508496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:08.509837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:08.511375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:08.517643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 436/862] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:08.523755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:08.526363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:08.527079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.527461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.527728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.528615 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:08.529680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:08.530496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:08.551145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 427/863] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 23 17:00:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:08.556286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:08.638176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f00a2-2d9d-4b19-890b-1b4db8033e41 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:08.674049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe283ea-94b2-4670-9056-1843f64ebb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:08.674823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe283ea-94b2-4670-9056-1843f64ebb27 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.675104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe283ea-94b2-4670-9056-1843f64ebb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.675380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe283ea-94b2-4670-9056-1843f64ebb27 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.676193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe283ea-94b2-4670-9056-1843f64ebb27 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:08.676496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe283ea-94b2-4670-9056-1843f64ebb27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:08.678193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe283ea-94b2-4670-9056-1843f64ebb27 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:08.680259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8792c76-6226-40f0-afdc-a6a39bfd25f9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:08.683484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 437/864] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:08.684987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70fed6-cf83-4c96-a407-269d783db8a5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.685526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70fed6-cf83-4c96-a407-269d783db8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.685967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70fed6-cf83-4c96-a407-269d783db8a5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.689951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 438/865] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:08.694191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2e4c-d3f9-4803-a7b9-1584073befc9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.694777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2e4c-d3f9-4803-a7b9-1584073befc9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.695257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2e4c-d3f9-4803-a7b9-1584073befc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.715183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ebcb2e4c-d3f9-4803-a7b9-1584073befc9 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:08.716577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ebcb2e4c-d3f9-4803-a7b9-1584073befc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:08.735934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da9e6-07d1-4592-9afc-967731ba2097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:08.737019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:08.737722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da9e6-07d1-4592-9afc-967731ba2097 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:08.739217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da9e6-07d1-4592-9afc-967731ba2097 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:08.739735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5da9e6-07d1-4592-9afc-967731ba2097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:08.806032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 439/866] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:08.810431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:08.826648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5da9e6-07d1-4592-9afc-967731ba2097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:08.828493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5da9e6-07d1-4592-9afc-967731ba2097 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:08.832560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb2e4c-d3f9-4803-a7b9-1584073befc9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:08.959235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 428/867] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 17:00:08.960208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb2e4c-d3f9-4803-a7b9-1584073befc9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:08.964768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da9e6-07d1-4592-9afc-967731ba2097 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:09.004444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cffd3-2267-4276-925b-9595bd58c59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:09.005130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cffd3-2267-4276-925b-9595bd58c59d None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:09.005408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cffd3-2267-4276-925b-9595bd58c59d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:09.005676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cffd3-2267-4276-925b-9595bd58c59d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:09.006874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cffd3-2267-4276-925b-9595bd58c59d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:09.008626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cffd3-2267-4276-925b-9595bd58c59d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:09.028301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 440/868] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:00:08 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:00:09.062056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:09.081044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5da9e6-07d1-4592-9afc-967731ba2097 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:09.126594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:09.127421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:09.127756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:09.128035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:09.139821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:09.141333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:09.161748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:09.162755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:09.163652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:09.163652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:09.163652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:09.163652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:09.164365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 429/869] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:09.169424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cffd3-2267-4276-925b-9595bd58c59d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:09.187242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:09.284647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cffd3-2267-4276-925b-9595bd58c59d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:09.320116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:09.320890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:09.321073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:09.321333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:09.322094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:09.322399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:09.323763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:09.336817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 441/870] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:09.342475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:09.445349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be572ea1-bb4d-475c-a0c7-0f06aba5343b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:09.476880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:09.482164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:09.483000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:09.483285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:09.483558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:09.491190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:09.492650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:09.506852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:09.507768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:09.509110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 430/871] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:09.514047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:09.591422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:09.624206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70f3a0-558e-46ac-aa52-ebee5c4f30e8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:09.659643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d3d8a-52e1-45bd-af3e-8f5324ee5480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:09.661093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3d8a-52e1-45bd-af3e-8f5324ee5480 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:09.661594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3d8a-52e1-45bd-af3e-8f5324ee5480 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:09.662086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3d8a-52e1-45bd-af3e-8f5324ee5480 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:09.663070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d3d8a-52e1-45bd-af3e-8f5324ee5480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:09.663569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d3d8a-52e1-45bd-af3e-8f5324ee5480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:09.665176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d3d8a-52e1-45bd-af3e-8f5324ee5480 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:09.677938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 442/872] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:09.684744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:09.798803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c7182-f35e-4c99-9875-0ab09b91fc1f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:09.834669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c64af5-e796-4314-9a0f-efdc4a08684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:09.835334 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64af5-e796-4314-9a0f-efdc4a08684a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:09.835611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64af5-e796-4314-9a0f-efdc4a08684a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:09.835882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c64af5-e796-4314-9a0f-efdc4a08684a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:09.836714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c64af5-e796-4314-9a0f-efdc4a08684a None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=faa0343291164cbc9f9ca0aa754ecad3) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:09.837021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c64af5-e796-4314-9a0f-efdc4a08684a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:09.838487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c64af5-e796-4314-9a0f-efdc4a08684a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:09.845006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 431/873] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:09 2022] GET /identity/v3/role_assignments?user.id=faa0343291164cbc9f9ca0aa754ecad3&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:09.885287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487cb6-7b75-4316-95fb-934c3755291d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:09.885591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487cb6-7b75-4316-95fb-934c3755291d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:09.885900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487cb6-7b75-4316-95fb-934c3755291d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:09.887618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 443/874] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:09.893286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8e5f-def1-486e-ac8e-4c2589e15f15 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:09.893581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8e5f-def1-486e-ac8e-4c2589e15f15 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:09.893904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8e5f-def1-486e-ac8e-4c2589e15f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:09.913314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f52b8e5f-def1-486e-ac8e-4c2589e15f15 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:09.914597 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f52b8e5f-def1-486e-ac8e-4c2589e15f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:09.972288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:09.991674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 432/875] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:10.014897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487cb6-7b75-4316-95fb-934c3755291d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:10.122507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487cb6-7b75-4316-95fb-934c3755291d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:10.151570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:10.159083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:10.159955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:10.160240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:10.160515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:10.161366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:10.162781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:10.174932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:10.176151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:10.176993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 444/876] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:10.182539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8e5f-def1-486e-ac8e-4c2589e15f15 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:10.291582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8e5f-def1-486e-ac8e-4c2589e15f15 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:10.326410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bfb6a-e6bd-4369-b797-f54dc5fa3e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:10.327428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bfb6a-e6bd-4369-b797-f54dc5fa3e39 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:10.327705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bfb6a-e6bd-4369-b797-f54dc5fa3e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:10.327973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bfb6a-e6bd-4369-b797-f54dc5fa3e39 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:10.328685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bfb6a-e6bd-4369-b797-f54dc5fa3e39 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:10.328986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bfb6a-e6bd-4369-b797-f54dc5fa3e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:10.330389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bfb6a-e6bd-4369-b797-f54dc5fa3e39 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:10.335661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 433/877] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:10.342965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:10.453418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae63e63-fbd4-4004-bfa9-7a463f483c57 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:10.488376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4956193-543f-40b9-81fe-eb654e17246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:10.489325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956193-543f-40b9-81fe-eb654e17246b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:10.489761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956193-543f-40b9-81fe-eb654e17246b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:10.490199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956193-543f-40b9-81fe-eb654e17246b None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:10.491076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4956193-543f-40b9-81fe-eb654e17246b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:10.491528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4956193-543f-40b9-81fe-eb654e17246b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:10.493027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4956193-543f-40b9-81fe-eb654e17246b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:10.498248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 445/878] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:10.821020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f768c-0cc6-4687-9cf0-16e0a140bd24 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:10.821555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f768c-0cc6-4687-9cf0-16e0a140bd24 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:10.821555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f768c-0cc6-4687-9cf0-16e0a140bd24 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:10.823279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 434/879] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:10.828811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53cda-64c3-4569-8d52-b73ecbb6dc55 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:10.829108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53cda-64c3-4569-8d52-b73ecbb6dc55 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:10.829388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53cda-64c3-4569-8d52-b73ecbb6dc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:10.847486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6cb53cda-64c3-4569-8d52-b73ecbb6dc55 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:10.849370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6cb53cda-64c3-4569-8d52-b73ecbb6dc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:10.914742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:10.926855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 446/880] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:10.950410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f768c-0cc6-4687-9cf0-16e0a140bd24 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:11.004903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:11.056065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f768c-0cc6-4687-9cf0-16e0a140bd24 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:11.090860 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01d836-e822-4f97-92a8-88c60f8b6ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:11.091427 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d836-e822-4f97-92a8-88c60f8b6ca2 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:11.091704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d836-e822-4f97-92a8-88c60f8b6ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:11.091973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d836-e822-4f97-92a8-88c60f8b6ca2 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:11.092710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01d836-e822-4f97-92a8-88c60f8b6ca2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:11.094102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01d836-e822-4f97-92a8-88c60f8b6ca2 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:11.111941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 435/881] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:00:10 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:11.282184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a584b-bba2-48f2-bad5-a342796f9173 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:11.282605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a584b-bba2-48f2-bad5-a342796f9173 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:11.282784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a584b-bba2-48f2-bad5-a342796f9173 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:11.284266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 447/882] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:11.289647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1433fe1-f3a6-491a-a892-4623e79051cd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:11.289960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1433fe1-f3a6-491a-a892-4623e79051cd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:11.290235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1433fe1-f3a6-491a-a892-4623e79051cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:11.308481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d1433fe1-f3a6-491a-a892-4623e79051cd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:11.310054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d1433fe1-f3a6-491a-a892-4623e79051cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:11.387071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 436/883] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:11.409492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a584b-bba2-48f2-bad5-a342796f9173 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:11.518167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a584b-bba2-48f2-bad5-a342796f9173 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:11.553557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:11.554386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:11.554663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:11.554931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:11.555586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:11.556947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:11.571910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:11.572980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:11.573905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 448/884] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:11.580394 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1433fe1-f3a6-491a-a892-4623e79051cd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:11.631823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:11.698106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1433fe1-f3a6-491a-a892-4623e79051cd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:11.734922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:11.735599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:11.735935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:11.736218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:11.736938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:11.737245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:11.739265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:11.744499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 437/885] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:11.750223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:11.806259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:11.855356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443f7b3-ea44-4f1c-b68a-2453f3e74678 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:11.893154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:11.893858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:11.894142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:11.894413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:11.895213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:11.895517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:11.896896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:11.902441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 449/886] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:11.908290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:12.015055 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:12.018050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182d441-d181-44cd-a529-df30abc628fb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:12.054577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb168a-1434-4fad-962b-4273ddc4e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:12.055254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb168a-1434-4fad-962b-4273ddc4e9eb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.055539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb168a-1434-4fad-962b-4273ddc4e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.055807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb168a-1434-4fad-962b-4273ddc4e9eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.056608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb168a-1434-4fad-962b-4273ddc4e9eb None admin] RBAC: Adding query filter params (interface=public, service_id=7a8f00e0402f4877bc53a98c814dc071, region_id=RegionOne) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:12.056922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb168a-1434-4fad-962b-4273ddc4e9eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:12.058355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb168a-1434-4fad-962b-4273ddc4e9eb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:12.063975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 438/887] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 23 17:00:11 2022] GET /identity/v3/endpoints?service_id=7a8f00e0402f4877bc53a98c814dc071&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:12.069883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:12.075338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2364-e671-4b8c-8bf9-6ebeb4d76f2c None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.075632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2364-e671-4b8c-8bf9-6ebeb4d76f2c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.075911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca2364-e671-4b8c-8bf9-6ebeb4d76f2c None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.077885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 439/888] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:12.083341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b949-be10-4dcc-ad79-e3679d7fb440 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.083915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b949-be10-4dcc-ad79-e3679d7fb440 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.084200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b949-be10-4dcc-ad79-e3679d7fb440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.102184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1ca0b949-be10-4dcc-ad79-e3679d7fb440 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:12.103705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1ca0b949-be10-4dcc-ad79-e3679d7fb440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:12.182075 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30758-11e7-473b-ac5b-aa6bb35df75d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:12.186189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 440/889] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:12.199698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:12.204349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0b949-be10-4dcc-ad79-e3679d7fb440 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:12.218213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff9004-258e-4d58-a9b7-0a490e876c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:12.218895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff9004-258e-4d58-a9b7-0a490e876c51 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.219173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff9004-258e-4d58-a9b7-0a490e876c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.219514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff9004-258e-4d58-a9b7-0a490e876c51 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.220156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff9004-258e-4d58-a9b7-0a490e876c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:12.221658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff9004-258e-4d58-a9b7-0a490e876c51 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:12.228690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 450/890] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 17:00:12 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:00:12.314421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:12.321089 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0b949-be10-4dcc-ad79-e3679d7fb440 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:12.363087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc43d6b-0daa-4982-86eb-6dd017ca3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:12.363955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc43d6b-0daa-4982-86eb-6dd017ca3c28 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.364320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc43d6b-0daa-4982-86eb-6dd017ca3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.364591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc43d6b-0daa-4982-86eb-6dd017ca3c28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.377065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc43d6b-0daa-4982-86eb-6dd017ca3c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-bfc43d6b-0daa-4982-86eb-6dd017ca3c28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:12.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:12.386865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:12.387721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 441/891] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 23 17:00:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:12.395554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff9004-258e-4d58-a9b7-0a490e876c51 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:12.499764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff9004-258e-4d58-a9b7-0a490e876c51 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:12.537725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447876b-8865-4ea6-82ac-826bec6281fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:12.538785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447876b-8865-4ea6-82ac-826bec6281fb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.539291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447876b-8865-4ea6-82ac-826bec6281fb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.539758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447876b-8865-4ea6-82ac-826bec6281fb None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.540697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447876b-8865-4ea6-82ac-826bec6281fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:12.541197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447876b-8865-4ea6-82ac-826bec6281fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:12.542801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447876b-8865-4ea6-82ac-826bec6281fb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:12.552029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 451/892] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 23 17:00:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:12.557888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc43d6b-0daa-4982-86eb-6dd017ca3c28 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:12.661146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc43d6b-0daa-4982-86eb-6dd017ca3c28 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:12.697446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:12.698294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.698575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.698847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.709417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f14f-1c77-43f3-8ef1-aca27bc4301e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.710089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f14f-1c77-43f3-8ef1-aca27bc4301e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.710601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f14f-1c77-43f3-8ef1-aca27bc4301e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.711296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:12.712677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 452/893] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:12.712784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:12.718163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e76318-f931-4293-8d03-6eba0b0cf265 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.718723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e76318-f931-4293-8d03-6eba0b0cf265 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.719198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e76318-f931-4293-8d03-6eba0b0cf265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:12.731422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:12.732373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:12.733285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:12.733285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:12.733285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:12.733285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:12.733285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 442/894] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:12.738667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:12.739688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-07e76318-f931-4293-8d03-6eba0b0cf265 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:12.741078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-07e76318-f931-4293-8d03-6eba0b0cf265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:12.748528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:12.791940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:12.841829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 453/895] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:12.852663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169eb7a-5aed-4ae6-9b96-114f9aa44ec7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:12.857986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e76318-f931-4293-8d03-6eba0b0cf265 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:12.895688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:12.896379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:12.896661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:12.896950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:12.898336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:12.898657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:12.900058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:12.915809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 443/896] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:12.921364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:12.970355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e76318-f931-4293-8d03-6eba0b0cf265 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:13.012455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:13.012822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d9499-1c21-40ce-a148-f837f1b2f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:13.013607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d9499-1c21-40ce-a148-f837f1b2f6c3 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.013739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d9499-1c21-40ce-a148-f837f1b2f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.013942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d9499-1c21-40ce-a148-f837f1b2f6c3 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.014710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d9499-1c21-40ce-a148-f837f1b2f6c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:13.016065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d9499-1c21-40ce-a148-f837f1b2f6c3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:13.033971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 454/897] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:00:12 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:00:13.064268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dd9fe-b50c-4203-99d5-8292498f5606 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:13.109447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038a468-3c10-4ea1-bb79-878547f59207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:13.110784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038a468-3c10-4ea1-bb79-878547f59207 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.111264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038a468-3c10-4ea1-bb79-878547f59207 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.111769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038a468-3c10-4ea1-bb79-878547f59207 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.121373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038a468-3c10-4ea1-bb79-878547f59207 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:13.123317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038a468-3c10-4ea1-bb79-878547f59207 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-7038a468-3c10-4ea1-bb79-878547f59207 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:13.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:13.141431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:13.142437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:13.145265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 444/898] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:00:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:13.151475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d9499-1c21-40ce-a148-f837f1b2f6c3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:13.189984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:13.265401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d9499-1c21-40ce-a148-f837f1b2f6c3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:13.302454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:13.303505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.304013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.304485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.305547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:13.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:13.307702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:13.314460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0950640-ab6d-4be8-bf37-292122f05072 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.315011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0950640-ab6d-4be8-bf37-292122f05072 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.315499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0950640-ab6d-4be8-bf37-292122f05072 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.317819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 445/899] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:00:13.323677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4d5a-ab98-4a57-8290-b6c9df711962 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.323964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4d5a-ab98-4a57-8290-b6c9df711962 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.324240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4d5a-ab98-4a57-8290-b6c9df711962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.333511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 455/900] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 23 17:00:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:13.339375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:13.344205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d6fc4d5a-ab98-4a57-8290-b6c9df711962 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:13.345451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d6fc4d5a-ab98-4a57-8290-b6c9df711962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:13.424202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 446/901] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:13.446625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:13.452713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4d5a-ab98-4a57-8290-b6c9df711962 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:13.455630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92707888-9a00-414e-834c-6406b52579e0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:13.494997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807556-b658-47ba-a3e6-174762fcaf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:13.495774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807556-b658-47ba-a3e6-174762fcaf6e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.496130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807556-b658-47ba-a3e6-174762fcaf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.496475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58807556-b658-47ba-a3e6-174762fcaf6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.514636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:13.570921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4d5a-ab98-4a57-8290-b6c9df711962 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:13.576229 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58807556-b658-47ba-a3e6-174762fcaf6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:13.578154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58807556-b658-47ba-a3e6-174762fcaf6e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:13.615354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:13.616187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.616465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.616734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.617396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:13.619437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:13.636188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:13.637232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:13.638146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 447/902] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 23 17:00:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:13.645279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:13.685516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:13.694082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 456/903] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:13 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 17:00:13.702223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807556-b658-47ba-a3e6-174762fcaf6e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:13.761819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87566a83-fb99-4a86-aa49-a6bc767170e6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:13.784675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:13.808059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:13.808741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.809026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.809306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.810074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:13.810388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:13.811770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:13.812336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58807556-b658-47ba-a3e6-174762fcaf6e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:13.817976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 448/904] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:13.827457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:13.849718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:13.850946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.851401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.851893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.864437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:13.866323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:13.885520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:13.886707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:13.887732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:13.887732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:13.887732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:13.887732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:13.894069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 457/905] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:13.895613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:13.947903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:13.953402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb43b-3eee-4c72-8eb2-bb9dcb4e0149 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:13.993385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:13.994341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:13.994773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:13.995197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:13.996080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:13.996533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:13.998160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.003884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 449/906] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:14.010359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:14.019523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6808b6-4466-4409-b3b5-2abba4eb4126 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:14.055040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:14.056035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.056518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.056992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.057988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:14.058533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:14.060172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.069564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:14.074198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 458/907] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:14.080144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:14.130185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32e3e-e4e3-4ff5-8f70-1d9a1e1f3ef4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:14.172558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:14.173233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.173516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.173814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.174614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] RBAC: Adding query filter params (interface=public, service_id=135f8bdbfcc849d1ac1eed0e3e4a4e25, region_id=RegionOne) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:14.174930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:14.176638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.186682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 450/908] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 23 17:00:14 2022] GET /identity/v3/endpoints?service_id=135f8bdbfcc849d1ac1eed0e3e4a4e25&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:14.188286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:14.194091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047dfd-4b1f-483d-8f2d-45e9bf0d5e82 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:14.198771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:14.245047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:14.246926 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.247448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.248173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.257625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:14.259894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:14.280897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:14.282016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:14.283001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:14.283001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:14.283001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:14.283001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:14.283001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:14.283001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:14.283001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:14.283001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:14.284637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 459/909] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:14.289161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:14.318078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d4db1-af34-4e4d-8c4d-6f7dfbd10656 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:14.329549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:14.356838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8706d08-8646-4323-90f7-ff4c50bbed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:14.357581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706d08-8646-4323-90f7-ff4c50bbed6e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.357819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706d08-8646-4323-90f7-ff4c50bbed6e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.358082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706d08-8646-4323-90f7-ff4c50bbed6e None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.358770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8706d08-8646-4323-90f7-ff4c50bbed6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:14.360142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8706d08-8646-4323-90f7-ff4c50bbed6e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.373640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 451/910] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 17:00:14 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:00:14.373640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b973-13b7-4c8e-9dcb-8dba143b92ef None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.373640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b973-13b7-4c8e-9dcb-8dba143b92ef None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.373640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b973-13b7-4c8e-9dcb-8dba143b92ef None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.373640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 452/911] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:14.376308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076dc3e-2754-4c0b-9e91-40bcb541e977 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.376675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076dc3e-2754-4c0b-9e91-40bcb541e977 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.376868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076dc3e-2754-4c0b-9e91-40bcb541e977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.396577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2076dc3e-2754-4c0b-9e91-40bcb541e977 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:14.397854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2076dc3e-2754-4c0b-9e91-40bcb541e977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:14.425611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a532-0461-4406-8d18-ea822adcff16 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:14.463711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:14.464389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.464672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.464947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.465753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:14.466108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:14.467570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.485944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 460/912] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:14.486919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:14.493820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 453/913] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:14.517014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076dc3e-2754-4c0b-9e91-40bcb541e977 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:14.528369 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:14.613034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3554-061b-4367-8e05-a5fb96434319 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:14.649472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:14.650580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.651095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.651574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.652087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076dc3e-2754-4c0b-9e91-40bcb541e977 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:14.652846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] RBAC: Adding query filter params (role.id=1ba2d60a4f5e4f23bcc0141c58e7362d, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=faa0343291164cbc9f9ca0aa754ecad3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:14.653362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:14.653621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:14.655220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.662931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 461/914] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:14 2022] GET /identity/v3/role_assignments?user.id=faa0343291164cbc9f9ca0aa754ecad3&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=1ba2d60a4f5e4f23bcc0141c58e7362d => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:14.694135 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:14.694987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.695266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.695539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.696212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:14.697617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:14.711150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:14.712278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:14.713169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 454/915] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:14.723112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:14.822648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:14.836830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9e107-1a4f-4053-ab89-c4d3af0cc37d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:14.872167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:14.872852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:14.873132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:14.873406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:14.874163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:14.874466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:14.875840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:14.881665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 462/916] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:14.887374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:14.994449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc5e25-a4c5-4f6f-8c56-a4101e56f1d3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:15.029128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da918e55-3898-4892-bcb9-2c57811b6f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:15.029816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918e55-3898-4892-bcb9-2c57811b6f8b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:15.030122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918e55-3898-4892-bcb9-2c57811b6f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:15.030399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da918e55-3898-4892-bcb9-2c57811b6f8b None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:15.031118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da918e55-3898-4892-bcb9-2c57811b6f8b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:15.031423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da918e55-3898-4892-bcb9-2c57811b6f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:15.032804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da918e55-3898-4892-bcb9-2c57811b6f8b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:15.038722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 455/917] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jun 23 17:00:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:15.044394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:15.148323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e4d60-65c2-4896-bf68-9a7caa54f96f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:15.185107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b57d2-3dac-44ad-8171-f180ae3f70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:15.185774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b57d2-3dac-44ad-8171-f180ae3f70b7 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:15.186084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b57d2-3dac-44ad-8171-f180ae3f70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:15.186361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b57d2-3dac-44ad-8171-f180ae3f70b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:15.187132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b57d2-3dac-44ad-8171-f180ae3f70b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:15.188494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b57d2-3dac-44ad-8171-f180ae3f70b7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:15.212175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 463/918] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:00:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:15.259341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd513-10ec-445e-8e60-9bf058a44849 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:15.259668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd513-10ec-445e-8e60-9bf058a44849 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:15.259917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd513-10ec-445e-8e60-9bf058a44849 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:15.261618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 456/919] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:15.267592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8637-b536-443c-93e5-becdb6ba97a3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:15.267923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8637-b536-443c-93e5-becdb6ba97a3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:15.268159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8637-b536-443c-93e5-becdb6ba97a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:15.287340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1f8e8637-b536-443c-93e5-becdb6ba97a3 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:15.288639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1f8e8637-b536-443c-93e5-becdb6ba97a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:15.291146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:15.372990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 464/920] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:15.396412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd513-10ec-445e-8e60-9bf058a44849 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:15.430222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:15.511870 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd513-10ec-445e-8e60-9bf058a44849 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:15.547954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:15.549169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:15.549663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:15.550210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:15.551363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:15.552969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:15.566041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:15.567093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:15.567954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:15.570872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 457/921] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:15.577457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8637-b536-443c-93e5-becdb6ba97a3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:15.680732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8637-b536-443c-93e5-becdb6ba97a3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:15.721136 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:15.722367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:15.722963 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:15.723450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:15.724381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:15.724895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:15.726496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:15.727857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:15.733364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 465/922] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:15.739552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:15.840254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:15.847799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4fea1-e6dc-49f8-862c-8fe46b786d8f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:15.885907 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:15.886975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:15.887469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:15.887944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:15.888866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:15.889377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:15.891023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:15.896940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 458/923] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:15.903094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:16.009963 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64f83-ddd9-4669-b2e2-cb082c92d75e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:16.044182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a337f-b88d-48c2-b125-f5f5e9ee51d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:16.044848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a337f-b88d-48c2-b125-f5f5e9ee51d5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:16.045128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a337f-b88d-48c2-b125-f5f5e9ee51d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:16.045404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a337f-b88d-48c2-b125-f5f5e9ee51d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:16.046234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a337f-b88d-48c2-b125-f5f5e9ee51d5 None admin] RBAC: Adding query filter params (interface=public, service_id=bbb5333d2b8b4dafa830cbb1eb984b85, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:16.046543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a337f-b88d-48c2-b125-f5f5e9ee51d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:16.047914 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a337f-b88d-48c2-b125-f5f5e9ee51d5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:16.055965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 466/924] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 23 17:00:15 2022] GET /identity/v3/endpoints?service_id=bbb5333d2b8b4dafa830cbb1eb984b85&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:16.061640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:16.164552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b24ce-d432-41cc-9b75-77944ec6babb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:16.200372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff494d0-e043-48a1-8e6d-b586fb7e6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:16.201421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff494d0-e043-48a1-8e6d-b586fb7e6c50 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:16.202276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff494d0-e043-48a1-8e6d-b586fb7e6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:16.202765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff494d0-e043-48a1-8e6d-b586fb7e6c50 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:16.203662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff494d0-e043-48a1-8e6d-b586fb7e6c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:16.205237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff494d0-e043-48a1-8e6d-b586fb7e6c50 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:16.212049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 459/925] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 17:00:16 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:00:16.543432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caffbf5-1287-485e-b0c7-a56dbdf9bc41 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:16.543791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caffbf5-1287-485e-b0c7-a56dbdf9bc41 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:16.544117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caffbf5-1287-485e-b0c7-a56dbdf9bc41 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:16.545771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 467/926] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:16.551188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafdfd-e568-4c4f-b81b-81e0f826cbfd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:16.551476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafdfd-e568-4c4f-b81b-81e0f826cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:16.551746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfafdfd-e568-4c4f-b81b-81e0f826cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:16.568808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-dbfafdfd-e568-4c4f-b81b-81e0f826cbfd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:16.570045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-dbfafdfd-e568-4c4f-b81b-81e0f826cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:16.587718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:16.647380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 460/927] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:16.670024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caffbf5-1287-485e-b0c7-a56dbdf9bc41 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:16.738867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:16.779727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caffbf5-1287-485e-b0c7-a56dbdf9bc41 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:16.814784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f896b-a28c-4780-983d-c008c22bd3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:16.815524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f896b-a28c-4780-983d-c008c22bd3dd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:16.815804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f896b-a28c-4780-983d-c008c22bd3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:16.816111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f896b-a28c-4780-983d-c008c22bd3dd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:16.816767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f896b-a28c-4780-983d-c008c22bd3dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:16.818165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f896b-a28c-4780-983d-c008c22bd3dd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bb8f896b-a28c-4780-983d-c008c22bd3dd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:16.831080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:16.832137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:16.832992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 468/928] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jun 23 17:00:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:16.838414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfafdfd-e568-4c4f-b81b-81e0f826cbfd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:16.851453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6880-b01e-4dfc-b4b6-95d413cf9076 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:16.851823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6880-b01e-4dfc-b4b6-95d413cf9076 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:16.852011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6880-b01e-4dfc-b4b6-95d413cf9076 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:16.853689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 469/929] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:16.858882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019ad41-2496-46ae-b713-5984d6793c62 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:16.859171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019ad41-2496-46ae-b713-5984d6793c62 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:16.859446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019ad41-2496-46ae-b713-5984d6793c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:16.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9019ad41-2496-46ae-b713-5984d6793c62 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:16.877579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9019ad41-2496-46ae-b713-5984d6793c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:16.953318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 470/930] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:16.956028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfafdfd-e568-4c4f-b81b-81e0f826cbfd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:16.975897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019ad41-2496-46ae-b713-5984d6793c62 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.001560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.002293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.002822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.003102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.004169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:17.004453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.006458 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:17.013743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 461/931] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:17.019822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.039291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:17.044068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:17.084748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019ad41-2496-46ae-b713-5984d6793c62 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.120586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e14d0-e260-4de8-8e05-19a473ab67af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.121772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e14d0-e260-4de8-8e05-19a473ab67af None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.122707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e14d0-e260-4de8-8e05-19a473ab67af None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.123212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e14d0-e260-4de8-8e05-19a473ab67af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.134807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c446e6e-7ca6-4cab-a1e5-14c282894700 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.138113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e14d0-e260-4de8-8e05-19a473ab67af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c17e14d0-e260-4de8-8e05-19a473ab67af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:17.148475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:17.149499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:17.150409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:17.151911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 471/932] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 23 17:00:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:17.159259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e14d0-e260-4de8-8e05-19a473ab67af None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.173936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.174680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.175027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.175395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.176268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:17.176659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.178250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:17.188357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 462/933] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:17.189809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.272030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e14d0-e260-4de8-8e05-19a473ab67af None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.292024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:17.295385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:17.315550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2edc96-aa68-4e2a-b6cf-bf2034c47f85 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.318328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2de1f-d3aa-4921-9f09-c21854612f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.319010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2de1f-d3aa-4921-9f09-c21854612f3b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.319288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2de1f-d3aa-4921-9f09-c21854612f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.319551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2de1f-d3aa-4921-9f09-c21854612f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.320313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2de1f-d3aa-4921-9f09-c21854612f3b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:17.320618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2de1f-d3aa-4921-9f09-c21854612f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.322012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2de1f-d3aa-4921-9f09-c21854612f3b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:17.331403 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 472/934] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 23 17:00:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:17.333294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3346-893a-42fb-ae8f-a71c31dd315f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.333575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3346-893a-42fb-ae8f-a71c31dd315f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.333895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3346-893a-42fb-ae8f-a71c31dd315f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.339122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 473/935] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:17.339122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c3346-893a-42fb-ae8f-a71c31dd315f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.363244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6088-ea9f-4985-9504-6453cc81106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.364086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6088-ea9f-4985-9504-6453cc81106e None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.364305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6088-ea9f-4985-9504-6453cc81106e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.364438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6088-ea9f-4985-9504-6453cc81106e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.365231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f6088-ea9f-4985-9504-6453cc81106e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.366665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f6088-ea9f-4985-9504-6453cc81106e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:17.389340 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 463/936] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:00:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:00:17.390694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379988df-0334-43e2-8014-eae0ddf42e14 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.390986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379988df-0334-43e2-8014-eae0ddf42e14 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.391262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379988df-0334-43e2-8014-eae0ddf42e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.409886 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-379988df-0334-43e2-8014-eae0ddf42e14 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:17.411211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-379988df-0334-43e2-8014-eae0ddf42e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:17.494057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c3346-893a-42fb-ae8f-a71c31dd315f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.505901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 464/937] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:17.529264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379988df-0334-43e2-8014-eae0ddf42e14 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.538260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.539920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.540201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.540474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.555424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.557699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:17.578619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:17.579587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:17.580492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:17.580492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:17.580492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:17.580492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:17.580492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 474/938] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:17.586294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.614358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:17.615705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:17.657975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379988df-0334-43e2-8014-eae0ddf42e14 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.704061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.704738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.705020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.705295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.706069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.707561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:17.708945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING keystone.server.flask.common [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 17:00:17.714438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397ff8-52f3-4c50-a112-1309721c84ec None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.729978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.sql.core [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 17:00:17.729978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 17:00:17.729978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [parameters: {'id': 'df8464941639405181f80682f15c44fa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 17:00:17.729978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df8464941639405181f80682f15c44fa.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df8464941639405181f80682f15c44fa. Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application conn.query(q) Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 17:00:17.738433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result.read() Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 17:00:17.739293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application next(self.gen) Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application yield resource Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application next(self.gen) Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise self.value Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application session.commit() Jun 23 17:00:17.740325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.session.flush() Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application compat.raise_( Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 17:00:17.741251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 17:00:17.742222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application conn.query(q) Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result.read() Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 17:00:17.743053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [parameters: {'id': 'df8464941639405181f80682f15c44fa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:17.743919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:17.744718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df8464941639405181f80682f15c44fa. Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 465/939] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Jun 23 17:00:17 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:17.748048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.771011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.772977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.773702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.774201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.775798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:17.776462 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.778453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:17.795410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 475/940] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:17.800284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.873569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0a960-3e5d-437a-b23a-89d8c38f4b84 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.899092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:17.906767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:17.919285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c355008-6ae5-47f4-b964-0a3ece74b619 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:17.924504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.925656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.926174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.926663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.936434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.938143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:17.952762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:17.953722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:17.954652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 466/941] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:17.959954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:17.975312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:17.976507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:17.977060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:17.977587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:17.985885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:17.987754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:18.004099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:18.005139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:18.006146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:18.013324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 476/942] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:00:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:18.014435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:18.068992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad54aa9-4bc4-4294-862d-23950cc29ca8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.104746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:18.105415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.105696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.105999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.106760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:18.107065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:18.108516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.122854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3d0a-9ff1-4408-8f1e-9cdbc53a4439 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.129894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 467/943] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:18.166649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0398cb-172e-4317-b87f-061a1c57a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:18.167601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0398cb-172e-4317-b87f-061a1c57a675 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.168052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0398cb-172e-4317-b87f-061a1c57a675 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.168474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0398cb-172e-4317-b87f-061a1c57a675 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.169482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0398cb-172e-4317-b87f-061a1c57a675 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:18.169994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0398cb-172e-4317-b87f-061a1c57a675 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:18.171682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0398cb-172e-4317-b87f-061a1c57a675 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.192535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 477/944] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 23 17:00:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:18.198003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:18.249336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:18.301086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e27b3-d505-4c3c-b513-4004149f2925 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.301949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e27b3-d505-4c3c-b513-4004149f2925 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.302372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e27b3-d505-4c3c-b513-4004149f2925 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.304820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 478/945] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:00:18.309692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f6392-196e-4b47-bcff-f31b50c9bb25 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.311117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f6392-196e-4b47-bcff-f31b50c9bb25 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.311557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f6392-196e-4b47-bcff-f31b50c9bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.314227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aaa17-3633-4fbb-859b-3777c2107df5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.319067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:18.337106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e88f6392-196e-4b47-bcff-f31b50c9bb25 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:18.338464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e88f6392-196e-4b47-bcff-f31b50c9bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:18.357961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:18.359182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.359182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.359379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.372998 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:18.374503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:18.395728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:18.396654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:18.397573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:18.397573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:18.397573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:18.397573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:18.397824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 468/946] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:18.404011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:18.429882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 479/947] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:18.454452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f6392-196e-4b47-bcff-f31b50c9bb25 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:18.514946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:18.522992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539526d-ef9c-486c-bf83-cd30a751c008 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.562872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f6392-196e-4b47-bcff-f31b50c9bb25 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.563190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:18.564158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.564622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.565116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.566228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:18.566693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:18.568210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.581285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 469/948] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:18.587224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:18.604772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:18.605523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.605825 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.606127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.606778 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:18.608216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.610363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:18.622903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:18.624130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:18.625123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:18.632433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 480/949] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:18.635148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:18.726097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8b664-e03e-4e17-ae41-197329a6bbfb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.766473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd79a40-8262-49c2-912f-ef4c1275a1bd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.769563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:18.770737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.771170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.771603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.781017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:18.783474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:18.801125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:18.802293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:18.803407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:18.803407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:18.803407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:18.803407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:18.803407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:18.803407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:18.803407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:18.803407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:18.807291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 470/950] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:18.808529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:18.811131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:18.813301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.813776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.814235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.815111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:18.815582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:18.817322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.824632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 481/951] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:18.826173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:18.830938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:18.900546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:18.935086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea731e-bf1b-49cd-b810-32e5b078a20c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.953552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ac3d4-4755-4f21-bcbd-72e44727c645 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:18.976263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:18.977299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:18.977774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:18.978333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:18.979308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:18.979961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:18.981598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:18.999752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 471/952] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:19.000985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:19.001572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:19.001701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:19.001970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:19.002252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:19.003109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:19.003502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:19.005070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:19.012043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 482/953] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:19.017895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:19.104789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:19.131577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9027b0f-635f-45d2-ae51-23039b7749c1 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:19.135135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433496b-f65c-4b40-bd5d-4989525599b5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:19.164283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:19.174948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ac8e0-213f-44ba-a556-78bd11b22d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:19.175263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af863306-cc3b-42fa-8926-bcbcd2830636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:19.175957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af863306-cc3b-42fa-8926-bcbcd2830636 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:19.176283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af863306-cc3b-42fa-8926-bcbcd2830636 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:19.176559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af863306-cc3b-42fa-8926-bcbcd2830636 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:19.177027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac8e0-213f-44ba-a556-78bd11b22d75 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:19.177304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af863306-cc3b-42fa-8926-bcbcd2830636 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:19.177735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac8e0-213f-44ba-a556-78bd11b22d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:19.178248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac8e0-213f-44ba-a556-78bd11b22d75 None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/faa0343291164cbc9f9ca0aa754ecad3/roles/1ba2d60a4f5e4f23bcc0141c58e7362d` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:19.178684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af863306-cc3b-42fa-8926-bcbcd2830636 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:19.181323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ac8e0-213f-44ba-a556-78bd11b22d75 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=faa0343291164cbc9f9ca0aa754ecad3, role_id=1ba2d60a4f5e4f23bcc0141c58e7362d)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:19.183531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ac8e0-213f-44ba-a556-78bd11b22d75 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:19.200184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 483/954] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:00:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:00:19.200763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 472/955] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:00:19 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/faa0343291164cbc9f9ca0aa754ecad3/roles/1ba2d60a4f5e4f23bcc0141c58e7362d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:00:19.479661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5f28-db5e-40e5-aaf1-9d25787285e9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:19.480008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5f28-db5e-40e5-aaf1-9d25787285e9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:19.480227 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa5f28-db5e-40e5-aaf1-9d25787285e9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:19.481896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 484/956] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:19.487194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5f63-1969-4f0d-894e-a96f088f64bf None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:19.487485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5f63-1969-4f0d-894e-a96f088f64bf None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:19.487930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5f63-1969-4f0d-894e-a96f088f64bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:19.505468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0aba5f63-1969-4f0d-894e-a96f088f64bf None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:19.507023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0aba5f63-1969-4f0d-894e-a96f088f64bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:19.581279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 473/957] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:19.603715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa5f28-db5e-40e5-aaf1-9d25787285e9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:19.712969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa5f28-db5e-40e5-aaf1-9d25787285e9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:19.748216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:19.748940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:19.749217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:19.749488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:19.750176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:19.751657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:19.763821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:19.764990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:19.765993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 485/958] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:19.771517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5f63-1969-4f0d-894e-a96f088f64bf None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:19.834993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:19.878103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5f63-1969-4f0d-894e-a96f088f64bf None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:19.913040 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9d664-2c93-4c41-9c26-d9c4cb0418b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:19.913714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9d664-2c93-4c41-9c26-d9c4cb0418b9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:19.914023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9d664-2c93-4c41-9c26-d9c4cb0418b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:19.914286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9d664-2c93-4c41-9c26-d9c4cb0418b9 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:19.915007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9d664-2c93-4c41-9c26-d9c4cb0418b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:19.915307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9d664-2c93-4c41-9c26-d9c4cb0418b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:19.916682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9d664-2c93-4c41-9c26-d9c4cb0418b9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:19.922023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 474/959] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:19.927937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:19.979099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:20.035046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dedc1-3cc2-4439-98dc-46bc2c032857 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:20.068979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a60903-9f82-4b36-a256-a3f24ed07cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:20.069650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a60903-9f82-4b36-a256-a3f24ed07cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:20.069965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a60903-9f82-4b36-a256-a3f24ed07cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:20.070237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a60903-9f82-4b36-a256-a3f24ed07cd4 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:20.070952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a60903-9f82-4b36-a256-a3f24ed07cd4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:20.071257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a60903-9f82-4b36-a256-a3f24ed07cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:20.072631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a60903-9f82-4b36-a256-a3f24ed07cd4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:20.078119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 486/960] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:20.399837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae0d03-23b4-4de2-b112-76ff3bd1c2f5 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:20.399837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae0d03-23b4-4de2-b112-76ff3bd1c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:20.399837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae0d03-23b4-4de2-b112-76ff3bd1c2f5 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:20.400964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 475/961] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:20.409117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821bb1-392f-41d7-bb70-b9255a9f21a1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:20.409117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821bb1-392f-41d7-bb70-b9255a9f21a1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:20.409117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821bb1-392f-41d7-bb70-b9255a9f21a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:20.425736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-44821bb1-392f-41d7-bb70-b9255a9f21a1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:20.427330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-44821bb1-392f-41d7-bb70-b9255a9f21a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:20.495607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 487/962] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:20.520718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae0d03-23b4-4de2-b112-76ff3bd1c2f5 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:20.625078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae0d03-23b4-4de2-b112-76ff3bd1c2f5 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:20.649564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:20.660883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:20.661967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:20.662476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:20.662989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:20.663918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:20.665553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:20.681393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.sql.core [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 17:00:20.681393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 17:00:20.681393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [parameters: {'user_id': '842d4448d34845c2b5cba0945466472a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 17:00:20.681393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application conn.query(q) Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result.read() Jun 23 17:00:20.689892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 17:00:20.691235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application next(self.gen) Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application yield resource Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application next(self.gen) Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise self.value Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application session.commit() Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 17:00:20.692732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.session.flush() Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application compat.raise_( Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 17:00:20.693904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 17:00:20.694813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application conn.query(q) Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application result.read() Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 17:00:20.695669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [parameters: {'user_id': '842d4448d34845c2b5cba0945466472a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:20.697236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 17:00:20.699103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 17:00:20.700743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 17:00:20.700743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 17:00:20.700743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 17:00:20.700743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 17:00:20.700743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 17:00:20.700743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:20.700743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 476/963] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jun 23 17:00:20 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:20.701223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821bb1-392f-41d7-bb70-b9255a9f21a1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:20.745290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:20.805003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821bb1-392f-41d7-bb70-b9255a9f21a1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:20.840332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ea78e-4393-48de-8f2d-c09d200c150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:20.841155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ea78e-4393-48de-8f2d-c09d200c150f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:20.841442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ea78e-4393-48de-8f2d-c09d200c150f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:20.841708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ea78e-4393-48de-8f2d-c09d200c150f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:20.849518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ea78e-4393-48de-8f2d-c09d200c150f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:20.851005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ea78e-4393-48de-8f2d-c09d200c150f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-718ea78e-4393-48de-8f2d-c09d200c150f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:20.866267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:20.868587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:20.870715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 488/964] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:00:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:20.878030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:20.986219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe01070-d6e9-447a-af5e-cb7406c70055 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:21.021178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249a671-d140-42d1-afa6-c145d834dbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:21.021903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a671-d140-42d1-afa6-c145d834dbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.022323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a671-d140-42d1-afa6-c145d834dbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.022600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a671-d140-42d1-afa6-c145d834dbc3 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.023432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249a671-d140-42d1-afa6-c145d834dbc3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:21.023739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249a671-d140-42d1-afa6-c145d834dbc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:21.025402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249a671-d140-42d1-afa6-c145d834dbc3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:21.064300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 477/965] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jun 23 17:00:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:21.268383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8a136-d986-4740-84a2-6ee605db7815 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.268999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8a136-d986-4740-84a2-6ee605db7815 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.268999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8a136-d986-4740-84a2-6ee605db7815 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.270338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 489/966] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:21.275937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a93727-695f-49ae-9600-30e1199abeae None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.276227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a93727-695f-49ae-9600-30e1199abeae None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.276508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a93727-695f-49ae-9600-30e1199abeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.294291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-13a93727-695f-49ae-9600-30e1199abeae None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:21.295821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-13a93727-695f-49ae-9600-30e1199abeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:21.338226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:21.368304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 478/967] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:21.390724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114f99-955f-4cf0-a1d5-3adde9381816 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.391048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114f99-955f-4cf0-a1d5-3adde9381816 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.391280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114f99-955f-4cf0-a1d5-3adde9381816 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.391510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a93727-695f-49ae-9600-30e1199abeae None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:21.392652 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 490/968] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:21.397835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559490-d516-44d7-9288-c6e6c2b2e053 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.398303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559490-d516-44d7-9288-c6e6c2b2e053 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.398580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559490-d516-44d7-9288-c6e6c2b2e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.415617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f2559490-d516-44d7-9288-c6e6c2b2e053 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:21.416783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f2559490-d516-44d7-9288-c6e6c2b2e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:21.486839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 491/969] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:21.498283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a93727-695f-49ae-9600-30e1199abeae None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:21.509608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2559490-d516-44d7-9288-c6e6c2b2e053 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:21.534821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a264-98c5-4f33-89e5-31a70881391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:21.535684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a264-98c5-4f33-89e5-31a70881391b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.535965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a264-98c5-4f33-89e5-31a70881391b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.536222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a264-98c5-4f33-89e5-31a70881391b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.539732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:21.548672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57a264-98c5-4f33-89e5-31a70881391b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-ae57a264-98c5-4f33-89e5-31a70881391b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:21.558178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:21.559141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:21.560246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 479/970] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 23 17:00:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:21.565619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a264-98c5-4f33-89e5-31a70881391b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:21.605935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:21.618411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2559490-d516-44d7-9288-c6e6c2b2e053 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:21.652441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:21.653257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.653537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.653821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.654484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:21.655864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:21.667729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:21.668951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:21.670228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 492/971] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:21.674836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:21.680652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a264-98c5-4f33-89e5-31a70881391b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:21.724810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:21.725757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.726065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.726339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.727252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:21.727925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:21.729310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:21.743290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 480/972] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 23 17:00:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:21.744454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:21.778292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:21.787919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d6b05-52cc-49e5-8e1f-01e592937a52 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:21.823513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:21.824184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.824473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.824745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.825464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:21.825770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:21.827505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:21.832542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 493/973] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:21.838122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:21.843924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:21.850556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd248c-833f-4395-b938-fbba55974ae5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:21.887099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:21.887902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.888179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.888449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.900650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:21.902133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:21.919443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:21.925268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:21.926271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:21.926271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:21.926271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:21.926271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:21.926271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 481/974] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:21.926271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:21.952950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4492f-3139-4394-ac18-54fa694c3e6f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:21.988470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:21.989429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:21.989761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:21.990062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:21.990797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:21.991083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:21.992456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:22.002081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 494/975] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:22.003134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:22.028784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:22.038265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1828-2378-4edd-8c2f-492b6c488392 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:22.074013 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:22.074685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.074974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.075249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.075974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:22.076282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:22.078026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:22.090982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 482/976] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:22.096239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:22.107462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:22.113396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbfe00-214b-4422-9762-ae2473f06a2e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:22.148787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ce2f6-37bc-4bc5-9835-f75f7735d82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:22.149450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce2f6-37bc-4bc5-9835-f75f7735d82d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.149764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce2f6-37bc-4bc5-9835-f75f7735d82d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.150045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce2f6-37bc-4bc5-9835-f75f7735d82d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.150859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce2f6-37bc-4bc5-9835-f75f7735d82d None admin] RBAC: Adding query filter params (interface=admin, service_id=bbb5333d2b8b4dafa830cbb1eb984b85, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:22.151189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce2f6-37bc-4bc5-9835-f75f7735d82d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:22.152542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce2f6-37bc-4bc5-9835-f75f7735d82d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:22.161831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 495/977] 10.222.0.18 () {56 vars in 1249 bytes} [Thu Jun 23 17:00:22 2022] GET /identity/v3/endpoints?service_id=bbb5333d2b8b4dafa830cbb1eb984b85&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:22.161831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6ba3d-93df-485d-84ca-f671e79c5bb9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.161831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6ba3d-93df-485d-84ca-f671e79c5bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.161831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6ba3d-93df-485d-84ca-f671e79c5bb9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.161831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 496/978] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:22.163683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6ba3d-93df-485d-84ca-f671e79c5bb9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:22.207665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9693-4c40-4ed3-b1f9-53c9ac802c80 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:22.241409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5dc27-6332-4760-9e22-951336fa309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:22.242270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5dc27-6332-4760-9e22-951336fa309a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.242550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5dc27-6332-4760-9e22-951336fa309a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.242823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5dc27-6332-4760-9e22-951336fa309a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.247987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:22.250193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5dc27-6332-4760-9e22-951336fa309a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:22.252003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5dc27-6332-4760-9e22-951336fa309a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:22.263751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6ba3d-93df-485d-84ca-f671e79c5bb9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4ab5dc27-6332-4760-9e22-951336fa309a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:22.266987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:22.268000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 483/979] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:00:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285302-a85c-4e28-bcc1-e682226dae41 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.269897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285302-a85c-4e28-bcc1-e682226dae41 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.270768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285302-a85c-4e28-bcc1-e682226dae41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.287033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4e285302-a85c-4e28-bcc1-e682226dae41 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:22.288257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4e285302-a85c-4e28-bcc1-e682226dae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:22.299073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a446-1ecb-457f-a7e3-90418254c429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:22.299750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a446-1ecb-457f-a7e3-90418254c429 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.300033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a446-1ecb-457f-a7e3-90418254c429 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.300310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a446-1ecb-457f-a7e3-90418254c429 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.301043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a446-1ecb-457f-a7e3-90418254c429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:22.302435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a446-1ecb-457f-a7e3-90418254c429 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:22.308908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 497/980] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 17:00:22 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:00:22.309466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a446-1ecb-457f-a7e3-90418254c429 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:22.355096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:22.362870 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 484/981] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:22.386693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285302-a85c-4e28-bcc1-e682226dae41 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:22.453612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a446-1ecb-457f-a7e3-90418254c429 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:22.495887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:22.496852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.497283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.497736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.498786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:22.498977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285302-a85c-4e28-bcc1-e682226dae41 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:22.499761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:22.501358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:22.521839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 498/982] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jun 23 17:00:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:22.525877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:22.534715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5308d59-3e5d-45b9-bb95-09e6baccbc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:22.535664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308d59-3e5d-45b9-bb95-09e6baccbc65 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.535949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308d59-3e5d-45b9-bb95-09e6baccbc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.536229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5308d59-3e5d-45b9-bb95-09e6baccbc65 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.536970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5308d59-3e5d-45b9-bb95-09e6baccbc65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:22.537270 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:22.538412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5308d59-3e5d-45b9-bb95-09e6baccbc65 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:22.553899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 485/983] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:00:22 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:00:22.643820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373679de-d79c-46d6-92f9-80d8108ae2bc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:22.697060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a8762-ad5c-4c7c-b588-87bf78551f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:22.697736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a8762-ad5c-4c7c-b588-87bf78551f78 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:22.698055 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a8762-ad5c-4c7c-b588-87bf78551f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:22.698326 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a8762-ad5c-4c7c-b588-87bf78551f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:22.772828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a8762-ad5c-4c7c-b588-87bf78551f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:22.774321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a8762-ad5c-4c7c-b588-87bf78551f78 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:22.777829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:22.879247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 499/984] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:22 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:00:22.884780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5308d59-3e5d-45b9-bb95-09e6baccbc65 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:22.948158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:22.996356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5308d59-3e5d-45b9-bb95-09e6baccbc65 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:23.031741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:23.032547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:23.032822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:23.033095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:23.044275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:23.045737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:23.063084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:23.064075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:23.069693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:23.069693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:23.069693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:23.069693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:23.069693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 486/985] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:23.070570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a8762-ad5c-4c7c-b588-87bf78551f78 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:23.172871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a8762-ad5c-4c7c-b588-87bf78551f78 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:23.175851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:23.208729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:23.209401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:23.209680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:23.209983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:23.210705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:23.211010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:23.212383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:23.224324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 500/986] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:23.229782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:23.335015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832afbf-4460-413d-ad6d-7b0ef8febb9e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:23.345385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:23.370589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:23.371394 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:23.371675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:23.371945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:23.379551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:23.380737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:23.395460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:23.396355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:23.397848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 487/987] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:23.402512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:23.505418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba115ac-8d9d-40ca-96fc-1e9df099cca1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:23.539693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae2658-d48e-447e-9260-7001ce9bf4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:23.540353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2658-d48e-447e-9260-7001ce9bf4ec None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:23.540633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2658-d48e-447e-9260-7001ce9bf4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:23.540912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2658-d48e-447e-9260-7001ce9bf4ec None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:23.541703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae2658-d48e-447e-9260-7001ce9bf4ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:23.542036 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae2658-d48e-447e-9260-7001ce9bf4ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:23.543473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae2658-d48e-447e-9260-7001ce9bf4ec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:23.556067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 501/988] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:23.561898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:23.662662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86095744-bed9-4091-94a0-c72d83efd037 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:23.705593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a21fc-9008-4104-a098-034c50234abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:23.706321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a21fc-9008-4104-a098-034c50234abe None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:23.706646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a21fc-9008-4104-a098-034c50234abe None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:23.706874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a21fc-9008-4104-a098-034c50234abe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:23.707716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a21fc-9008-4104-a098-034c50234abe None admin] RBAC: Adding query filter params (role.id=1ba2d60a4f5e4f23bcc0141c58e7362d, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=faa0343291164cbc9f9ca0aa754ecad3) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:23.708026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a21fc-9008-4104-a098-034c50234abe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:23.709453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a21fc-9008-4104-a098-034c50234abe None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:23.715677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 488/989] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:23 2022] GET /identity/v3/role_assignments?user.id=faa0343291164cbc9f9ca0aa754ecad3&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=1ba2d60a4f5e4f23bcc0141c58e7362d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:24.386665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0a1d-537a-41b1-aabe-805de07d0c3a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:24.386919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0a1d-537a-41b1-aabe-805de07d0c3a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:24.387191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0a1d-537a-41b1-aabe-805de07d0c3a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:24.388767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 502/990] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:24.393949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7818e49-19f1-4646-9114-8b41e59deb16 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:24.394817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7818e49-19f1-4646-9114-8b41e59deb16 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:24.395105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7818e49-19f1-4646-9114-8b41e59deb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:24.413897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a7818e49-19f1-4646-9114-8b41e59deb16 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:24.415118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a7818e49-19f1-4646-9114-8b41e59deb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:24.444577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:24.489700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 489/991] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:24.512983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d0a1d-537a-41b1-aabe-805de07d0c3a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:24.540919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:24.599673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05734a82-5801-4357-8d55-2bdf66400bba None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:24.600245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05734a82-5801-4357-8d55-2bdf66400bba None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:24.600245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05734a82-5801-4357-8d55-2bdf66400bba None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:24.601602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 490/992] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:24.606483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7134-625c-435a-ab93-a4148bfab2a1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:24.606771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7134-625c-435a-ab93-a4148bfab2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:24.607048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7134-625c-435a-ab93-a4148bfab2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:24.621312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d0a1d-537a-41b1-aabe-805de07d0c3a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:24.625254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0a6a7134-625c-435a-ab93-a4148bfab2a1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:24.626496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0a6a7134-625c-435a-ab93-a4148bfab2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:24.656011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:24.656711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:24.657028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:24.657272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:24.657961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:24.659931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:24.672043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:24.673043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 17:00:24.673940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:24.677976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 503/993] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jun 23 17:00:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:24.679786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:24.709100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 491/994] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:24.731566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a7134-625c-435a-ab93-a4148bfab2a1 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:24.780030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:24.795690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03524bc-29b4-44cc-bc90-9606e008b2a0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:24.830369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:24.835869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:24.836520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:24.836805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:24.837080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:24.837819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:24.838120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:24.839498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:24.841875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a7134-625c-435a-ab93-a4148bfab2a1 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:24.844458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 504/995] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:24.850223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:24.885906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:24.886701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:24.886982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:24.887252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:24.887905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:24.889280 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:24.901261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:24.902316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:24.903194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:24.907717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 492/996] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:24.908313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:24.955516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712a3c-c0ab-4b3c-85f3-c853d6dc1b31 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:24.991163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:24.991865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:24.992110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:24.992415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:24.993241 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:24.993437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:24.994803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:25.001383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 505/997] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jun 23 17:00:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:25.006932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:25.021627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499d58b-6361-4df6-b913-4471c0eb67c7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:25.027599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:25.058266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:25.058925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:25.059205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:25.059485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:25.060193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:25.060496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:25.061890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:25.067213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 493/998] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:25.072958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:25.102788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:25.118154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ce97d-07ec-436c-8ced-f3ca7ab2b862 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:25.158597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66b7f-26ac-4f11-bb1f-c219f0ee91ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:25.159193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66b7f-26ac-4f11-bb1f-c219f0ee91ff None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:25.159931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66b7f-26ac-4f11-bb1f-c219f0ee91ff None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:25.160216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66b7f-26ac-4f11-bb1f-c219f0ee91ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:25.161254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66b7f-26ac-4f11-bb1f-c219f0ee91ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:25.163368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66b7f-26ac-4f11-bb1f-c219f0ee91ff None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:25.182604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2fad-99c1-4154-ae47-769b4a596a94 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:25.183177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 506/999] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:00:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:00:25.236648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:25.237545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:25.237854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:25.238128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:25.238862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] RBAC: Adding query filter params (type=compute) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:25.239170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:25.240621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:25.246841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 494/1000] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:25.252755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66b7f-26ac-4f11-bb1f-c219f0ee91ff None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:25.339366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:25.367730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66b7f-26ac-4f11-bb1f-c219f0ee91ff None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:25.404492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93354018-6381-45bc-b5a1-2977af7e76df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:25.405163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354018-6381-45bc-b5a1-2977af7e76df None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:25.405443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354018-6381-45bc-b5a1-2977af7e76df None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:25.405721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93354018-6381-45bc-b5a1-2977af7e76df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:25.406554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93354018-6381-45bc-b5a1-2977af7e76df None admin] RBAC: Adding query filter params (interface=public, service_id=4b40bb21545f4509850d17fef51a9673, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:25.406866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93354018-6381-45bc-b5a1-2977af7e76df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:25.408233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93354018-6381-45bc-b5a1-2977af7e76df None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:25.414036 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 507/1001] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 23 17:00:25 2022] GET /identity/v3/endpoints?service_id=4b40bb21545f4509850d17fef51a9673&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:25.419392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:25.504487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:25.525207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270ab6c-da93-496c-99cf-98a8456c3ace None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:25.559221 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5f859-4158-4009-be8f-18d26cd922f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:25.559885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5f859-4158-4009-be8f-18d26cd922f5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:25.560164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5f859-4158-4009-be8f-18d26cd922f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:25.560438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5f859-4158-4009-be8f-18d26cd922f5 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:25.561123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5f859-4158-4009-be8f-18d26cd922f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:25.562528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5f859-4158-4009-be8f-18d26cd922f5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:25.569118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 495/1002] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 17:00:25 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:00:25.743657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87106a-5598-4cd2-9660-14f7fc28cb45 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:25.744179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87106a-5598-4cd2-9660-14f7fc28cb45 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:25.744179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87106a-5598-4cd2-9660-14f7fc28cb45 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:25.745587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 508/1003] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:25.750922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee35d0-c8a7-46aa-bfa8-bb18735043ca None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:25.751377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee35d0-c8a7-46aa-bfa8-bb18735043ca None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:25.751457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee35d0-c8a7-46aa-bfa8-bb18735043ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:25.770053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-56ee35d0-c8a7-46aa-bfa8-bb18735043ca None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:25.771242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-56ee35d0-c8a7-46aa-bfa8-bb18735043ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:25.840533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 496/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:25.862746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87106a-5598-4cd2-9660-14f7fc28cb45 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:25.972395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87106a-5598-4cd2-9660-14f7fc28cb45 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:26.006448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:26.007239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:26.007547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:26.007776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] PATH_INFO: `/v3/services/image` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:26.008420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:26.009778 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:26.021542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:26.022785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:26.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 509/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 23 17:00:25 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:26.030565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee35d0-c8a7-46aa-bfa8-bb18735043ca None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:26.112680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:26.138076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee35d0-c8a7-46aa-bfa8-bb18735043ca None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:26.172669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427c95d-b1a5-4f93-9146-92570666fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:26.173338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c95d-b1a5-4f93-9146-92570666fe21 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:26.173616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c95d-b1a5-4f93-9146-92570666fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:26.173927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c95d-b1a5-4f93-9146-92570666fe21 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:26.174637 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427c95d-b1a5-4f93-9146-92570666fe21 None admin] RBAC: Adding query filter params (name=image) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:26.174984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427c95d-b1a5-4f93-9146-92570666fe21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:26.176363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427c95d-b1a5-4f93-9146-92570666fe21 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:26.181704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 497/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:26.187274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:26.191297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:26.291548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea68b9-8990-449f-a519-11344b94dabb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:26.328252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95b7aa-1909-4e1a-9e4e-ac248a0d7539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:26.328924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b7aa-1909-4e1a-9e4e-ac248a0d7539 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:26.329208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b7aa-1909-4e1a-9e4e-ac248a0d7539 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:26.329483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95b7aa-1909-4e1a-9e4e-ac248a0d7539 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:26.330224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95b7aa-1909-4e1a-9e4e-ac248a0d7539 None admin] RBAC: Adding query filter params (type=image) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:26.330530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95b7aa-1909-4e1a-9e4e-ac248a0d7539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:26.331956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95b7aa-1909-4e1a-9e4e-ac248a0d7539 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:26.336789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 510/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:27.219839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24959-4bef-430e-aea5-0f30e4c2ecb8 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:27.220375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24959-4bef-430e-aea5-0f30e4c2ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:27.220375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd24959-4bef-430e-aea5-0f30e4c2ecb8 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:27.221982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 498/1008] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:27.227435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42df9-c28b-4ea9-b093-626b7bc8b695 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:27.227863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42df9-c28b-4ea9-b093-626b7bc8b695 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:27.227940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42df9-c28b-4ea9-b093-626b7bc8b695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:27.247238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1be42df9-c28b-4ea9-b093-626b7bc8b695 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:27.248439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1be42df9-c28b-4ea9-b093-626b7bc8b695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:27.312917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:27.319428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 511/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:27.343159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd24959-4bef-430e-aea5-0f30e4c2ecb8 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:27.458311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd24959-4bef-430e-aea5-0f30e4c2ecb8 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:27.494175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f1f10-959d-4a5c-93d0-1d50a4fe55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:27.494889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1f10-959d-4a5c-93d0-1d50a4fe55c3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:27.495165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1f10-959d-4a5c-93d0-1d50a4fe55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:27.495436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1f10-959d-4a5c-93d0-1d50a4fe55c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:27.496610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f1f10-959d-4a5c-93d0-1d50a4fe55c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:27.498070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f1f10-959d-4a5c-93d0-1d50a4fe55c3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:27.504522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 499/1010] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:27.505599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be42df9-c28b-4ea9-b093-626b7bc8b695 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:27.603362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba538f-f76e-4d36-99a8-2c1a932f8181 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:27.603755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba538f-f76e-4d36-99a8-2c1a932f8181 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:27.604098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba538f-f76e-4d36-99a8-2c1a932f8181 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:27.605586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 500/1011] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:27.607785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be42df9-c28b-4ea9-b093-626b7bc8b695 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:27.610465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5310-fd51-4dd7-9d60-42737fcad443 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:27.610744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5310-fd51-4dd7-9d60-42737fcad443 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:27.611017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5310-fd51-4dd7-9d60-42737fcad443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:27.627359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a6df5310-fd51-4dd7-9d60-42737fcad443 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:27.628699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a6df5310-fd51-4dd7-9d60-42737fcad443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:27.630875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:27.644117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b95b-beae-4999-b80a-8d0f02fa2284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:27.644780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b95b-beae-4999-b80a-8d0f02fa2284 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:27.645086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b95b-beae-4999-b80a-8d0f02fa2284 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:27.645356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b95b-beae-4999-b80a-8d0f02fa2284 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:27.646139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b95b-beae-4999-b80a-8d0f02fa2284 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:27.647541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b95b-beae-4999-b80a-8d0f02fa2284 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:27.685825 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 512/1012] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:00:27 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:00:27.713482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 501/1013] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:27.736360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b95b-beae-4999-b80a-8d0f02fa2284 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:27.802177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:27.870233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b95b-beae-4999-b80a-8d0f02fa2284 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:27.908426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:27.909264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:27.909584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:27.910215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:27.910518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:27.911887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:27.924065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:27.925195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:27.926125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 513/1014] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:27.931783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5310-fd51-4dd7-9d60-42737fcad443 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:28.054256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5310-fd51-4dd7-9d60-42737fcad443 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:28.096267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:28.097082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:28.097850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:28.098146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:28.098868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:28.099178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:28.100629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:28.107781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 502/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:28.114083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:28.238652 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e057c-d551-4164-82a7-06f8d7b7d754 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:28.253538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:28.278298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051692fd-8261-4979-a82e-f3e15c1f7832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:28.278979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051692fd-8261-4979-a82e-f3e15c1f7832 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:28.279264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051692fd-8261-4979-a82e-f3e15c1f7832 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:28.279546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051692fd-8261-4979-a82e-f3e15c1f7832 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:28.280405 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051692fd-8261-4979-a82e-f3e15c1f7832 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:28.280715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051692fd-8261-4979-a82e-f3e15c1f7832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:28.282144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051692fd-8261-4979-a82e-f3e15c1f7832 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:28.292472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 514/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jun 23 17:00:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:28.295791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:28.301731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:28.403711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d69f6-77ba-4426-bb79-90625e5f8e3b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:28.403894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d69f6-77ba-4426-bb79-90625e5f8e3b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:28.404196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d69f6-77ba-4426-bb79-90625e5f8e3b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:28.405562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 515/1017] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:00:28.411209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96ee9-ae50-44aa-9405-5bc5f7c07b05 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:28.411599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96ee9-ae50-44aa-9405-5bc5f7c07b05 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:28.411950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96ee9-ae50-44aa-9405-5bc5f7c07b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:28.422140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60683f1-2aed-47d0-a29b-9f16ea97da7d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:28.429231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8eb96ee9-ae50-44aa-9405-5bc5f7c07b05 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:28.430482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8eb96ee9-ae50-44aa-9405-5bc5f7c07b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:28.473104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28321ff-8b71-4968-b429-ab686cf23c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:28.474102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28321ff-8b71-4968-b429-ab686cf23c5e None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:28.474636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28321ff-8b71-4968-b429-ab686cf23c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:28.475057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28321ff-8b71-4968-b429-ab686cf23c5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:28.476061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28321ff-8b71-4968-b429-ab686cf23c5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:28.477711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28321ff-8b71-4968-b429-ab686cf23c5e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:28.498726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 503/1018] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:00:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:28.511160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 516/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:28 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:28.534741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28321ff-8b71-4968-b429-ab686cf23c5e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:28.618917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:28.674205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28321ff-8b71-4968-b429-ab686cf23c5e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:28.722167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb1283-102e-4724-a0db-013985ac618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:28.723191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb1283-102e-4724-a0db-013985ac618d None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:28.723616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb1283-102e-4724-a0db-013985ac618d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:28.723887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb1283-102e-4724-a0db-013985ac618d None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:28.724852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb1283-102e-4724-a0db-013985ac618d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:28.727309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb1283-102e-4724-a0db-013985ac618d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:28.748191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 504/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:00:28 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:29.811846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bacadf-d3a6-446c-9dca-1648c2a62e4b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:29.812389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bacadf-d3a6-446c-9dca-1648c2a62e4b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:29.812389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bacadf-d3a6-446c-9dca-1648c2a62e4b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:29.813732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 517/1021] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:29.819765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111d14b-8ed7-4b5c-943a-ace9b2d5cd04 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:29.820190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111d14b-8ed7-4b5c-943a-ace9b2d5cd04 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:29.820291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111d14b-8ed7-4b5c-943a-ace9b2d5cd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:29.838791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d111d14b-8ed7-4b5c-943a-ace9b2d5cd04 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:29.839985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d111d14b-8ed7-4b5c-943a-ace9b2d5cd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:29.918284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 505/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:29.942884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bacadf-d3a6-446c-9dca-1648c2a62e4b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:30.053924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bacadf-d3a6-446c-9dca-1648c2a62e4b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:30.056315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:30.091986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2333-b68a-416a-aa5a-74eabbfd63e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:30.092795 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2333-b68a-416a-aa5a-74eabbfd63e3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:30.093078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2333-b68a-416a-aa5a-74eabbfd63e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:30.093316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2333-b68a-416a-aa5a-74eabbfd63e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:30.094573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2333-b68a-416a-aa5a-74eabbfd63e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:30.096025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2333-b68a-416a-aa5a-74eabbfd63e3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:30.098914 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 518/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:30.104664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111d14b-8ed7-4b5c-943a-ace9b2d5cd04 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:30.154931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:30.212936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111d14b-8ed7-4b5c-943a-ace9b2d5cd04 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:30.248755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e7427-9c7a-4ab3-a51b-3d4db2507a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:30.249430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7427-9c7a-4ab3-a51b-3d4db2507a4a None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:30.249709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7427-9c7a-4ab3-a51b-3d4db2507a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:30.250010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7427-9c7a-4ab3-a51b-3d4db2507a4a None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:30.250734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e7427-9c7a-4ab3-a51b-3d4db2507a4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:30.252203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e7427-9c7a-4ab3-a51b-3d4db2507a4a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:30.280666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 506/1024] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 17:00:30 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:30.692659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de09fa-93e5-42b6-b822-edc3d19f303a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:30.692968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de09fa-93e5-42b6-b822-edc3d19f303a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:30.693226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de09fa-93e5-42b6-b822-edc3d19f303a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:30.694675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 519/1025] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:30.700228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d52d-1c64-4add-be28-44e90bd9152b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:30.700523 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d52d-1c64-4add-be28-44e90bd9152b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:30.700814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089d52d-1c64-4add-be28-44e90bd9152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:30.718221 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e089d52d-1c64-4add-be28-44e90bd9152b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:30.719397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e089d52d-1c64-4add-be28-44e90bd9152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:30.788576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 507/1026] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:30.793919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3305-8679-40ac-a92a-c433b79c95ed None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:30.794179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3305-8679-40ac-a92a-c433b79c95ed None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:30.794469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3305-8679-40ac-a92a-c433b79c95ed None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:30.795958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 520/1027] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:30.801091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc427-0d43-426b-9dc8-af1768320201 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:30.801372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc427-0d43-426b-9dc8-af1768320201 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:30.801646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc427-0d43-426b-9dc8-af1768320201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:30.811807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df3305-8679-40ac-a92a-c433b79c95ed None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:30.820589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e1ecc427-0d43-426b-9dc8-af1768320201 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:30.821769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e1ecc427-0d43-426b-9dc8-af1768320201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:30.848196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:30.901829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 508/1028] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:30.921687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc427-0d43-426b-9dc8-af1768320201 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:30.931993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df3305-8679-40ac-a92a-c433b79c95ed None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:30.967412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5a3a2-2bcc-45fc-94a4-9eae143db73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:30.968150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a3a2-2bcc-45fc-94a4-9eae143db73f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:30.968430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a3a2-2bcc-45fc-94a4-9eae143db73f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:30.968701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5a3a2-2bcc-45fc-94a4-9eae143db73f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:30.979980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5a3a2-2bcc-45fc-94a4-9eae143db73f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ead5a3a2-2bcc-45fc-94a4-9eae143db73f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:30.988288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:30.989276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:30.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 521/1029] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 23 17:00:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:30.995451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5a3a2-2bcc-45fc-94a4-9eae143db73f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.028406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:31.038723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc427-0d43-426b-9dc8-af1768320201 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.075173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.075987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.076266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.077134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] PATH_INFO: `/v3/services/image` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.077713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.079258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:31.092744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:31.094010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:31.094884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 509/1030] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 23 17:00:30 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:31.099795 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.105746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5a3a2-2bcc-45fc-94a4-9eae143db73f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.128182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:31.148175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.149351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.150207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.150788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.151883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:31.152525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.154430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.163332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 522/1031] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 23 17:00:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:31.169187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.205410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9cc3c-0f76-4f9d-ae76-9a36ead9eeab None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.241588 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.242206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.242477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.242751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.243458 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] RBAC: Adding query filter params (name=image) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:31.243764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.245135 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.254910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 510/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:31.256509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.266609 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:31.273599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd12d-ab19-4ffe-a06d-44c924253f3f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.307148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.307950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.308225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.308489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.318954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.320397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:31.338033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:31.339246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:31.340166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:31.340166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:31.340166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:31.340166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:31.340166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 523/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:31.344824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.359524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:31.371071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0173715-357e-4dce-902b-044b4667be7e None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.406260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.406826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.407103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.407375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.408073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] RBAC: Adding query filter params (type=image) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:31.408375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.409850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.415065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 511/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:31.420784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.454893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad21afe-3ccb-46d3-8bd7-b496c5f951e8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.491179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.491897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.492124 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.492409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.493120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:31.493425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.494898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.513303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 524/1035] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:31.514440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.526732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:31.543478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f51814-5d11-4821-aa08-8b48b4a12211 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.583094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.583759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.584042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.584315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.585139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] RBAC: Adding query filter params (interface=public, service_id=2b8f3c723ca74617a1e7a3ecba00e8c5, region_id=RegionOne) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:31.585434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.586897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.593066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 512/1036] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/endpoints?service_id=2b8f3c723ca74617a1e7a3ecba00e8c5&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:31.598586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.618619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:31.631345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36896f4d-f066-4e9c-ad31-21adae106e37 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.667315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.668128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.668448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.668685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.676390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.677902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:31.694259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:31.695259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:31.696226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 525/1037] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:31.701188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.718712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccecaa-0046-4dbf-b9b4-972786bde6d9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.754385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bce30f-2c54-4de7-a819-12a59ad8335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.754983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bce30f-2c54-4de7-a819-12a59ad8335d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.755261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bce30f-2c54-4de7-a819-12a59ad8335d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.755533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bce30f-2c54-4de7-a819-12a59ad8335d None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.756457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bce30f-2c54-4de7-a819-12a59ad8335d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.757583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bce30f-2c54-4de7-a819-12a59ad8335d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.764373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 513/1038] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:00:31.770905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:31.812135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b55a9-b692-4f05-b12c-be1419133325 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:31.853567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:31.854285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:31.854564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:31.854838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:31.855703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:31.856011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:31.857482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:31.877202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 526/1039] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:31.883881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bce30f-2c54-4de7-a819-12a59ad8335d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:31.972053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:31.992400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bce30f-2c54-4de7-a819-12a59ad8335d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:32.027101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caf68b-7533-4852-ad17-53368224143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:32.027766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caf68b-7533-4852-ad17-53368224143b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.028045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caf68b-7533-4852-ad17-53368224143b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.028319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caf68b-7533-4852-ad17-53368224143b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.098917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caf68b-7533-4852-ad17-53368224143b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:32.100378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caf68b-7533-4852-ad17-53368224143b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:32.182637 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:32.206358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 514/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 17:00:32.212343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:32.321234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1414-6d7f-4ca7-b8c9-49fc0633dac4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:32.346452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:32.358234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:32.359042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.359320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.359593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.370342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:32.371796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:32.389515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:32.390568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:32.391530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:32.391530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:32.391530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:32.391530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:32.391530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 527/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:32.397322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1d8d-1abd-4274-a1a5-58a360395c41 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.397474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:32.397659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1d8d-1abd-4274-a1a5-58a360395c41 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.397913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1d8d-1abd-4274-a1a5-58a360395c41 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.399445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 515/1042] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:32.404394 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406765c-1240-41e9-884f-1b613a4f4b59 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.404691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406765c-1240-41e9-884f-1b613a4f4b59 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.404961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406765c-1240-41e9-884f-1b613a4f4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.421649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b406765c-1240-41e9-884f-1b613a4f4b59 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:32.422929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b406765c-1240-41e9-884f-1b613a4f4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:32.492388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 516/1043] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:32.499194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5610a1-b4c6-4e29-8ac9-ccf65c9cc605 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:32.515615 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406765c-1240-41e9-884f-1b613a4f4b59 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:32.535508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:32.536191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.536467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.536742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.537477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:32.537783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:32.539181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:32.556180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 528/1044] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:32.557287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:32.594973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:32.625090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406765c-1240-41e9-884f-1b613a4f4b59 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:32.635879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:32.662399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d70fa-f675-4a45-bc10-729d3aadfac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:32.663205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d70fa-f675-4a45-bc10-729d3aadfac2 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.663486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d70fa-f675-4a45-bc10-729d3aadfac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.663759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d70fa-f675-4a45-bc10-729d3aadfac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.664008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3b6d7-5200-4968-b596-d10df9d36259 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:32.674819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d70fa-f675-4a45-bc10-729d3aadfac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-4a9d70fa-f675-4a45-bc10-729d3aadfac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:32.684830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:32.686088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:32.687032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 517/1045] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:32.690126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d70fa-f675-4a45-bc10-729d3aadfac2 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:32.710128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:32.710944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.711709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.712002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.720578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:32.722193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:32.736468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:32.737576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:32.738820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:32.738820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:32.738820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:32.738820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:32.738820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:32.738820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:32.738820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:32.738820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:32.742833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 529/1046] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:32.743501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:32.819676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d70fa-f675-4a45-bc10-729d3aadfac2 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:32.858052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:32.858642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.858919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.859188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.860045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:32.860346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:32.861718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:32.867276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:32.871958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 518/1047] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:00:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:32.875281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11785e4-82d1-4d4a-819b-22d3d9d0ed72 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:32.878036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:32.911519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:32.920393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:32.921066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:32.921346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:32.921999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:32.922547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:32.922854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:32.924392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:32.937481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 530/1048] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:32.944031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:32.986336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631ebd8-1038-4d15-a339-938534413723 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:33.022524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1080f-d7f1-4bd7-a594-0055872f4cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:33.023412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1080f-d7f1-4bd7-a594-0055872f4cca None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:33.023689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1080f-d7f1-4bd7-a594-0055872f4cca None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:33.023962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1080f-d7f1-4bd7-a594-0055872f4cca None admin] PATH_INFO: `/v3/users/453486db3dd14260a0787437544f392e` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:33.038821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1080f-d7f1-4bd7-a594-0055872f4cca None admin] RBAC: Authorizing `identity:get_user(user_id=453486db3dd14260a0787437544f392e)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:33.040507 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1080f-d7f1-4bd7-a594-0055872f4cca None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:33.047539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 519/1049] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:32 2022] GET /identity/v3/users/453486db3dd14260a0787437544f392e => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:33.048796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1080f-d7f1-4bd7-a594-0055872f4cca None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:33.050418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a7525-6d93-404d-a9f8-faa4d205bf1b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:33.090588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:33.091264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:33.091538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:33.091818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:33.092660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] RBAC: Adding query filter params (role.id=1ba2d60a4f5e4f23bcc0141c58e7362d, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=10b3274005534830b0768b122769dd1a) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:33.092975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:33.094449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:33.109908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 531/1050] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:32 2022] GET /identity/v3/role_assignments?user.id=10b3274005534830b0768b122769dd1a&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=1ba2d60a4f5e4f23bcc0141c58e7362d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:33.155687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:33.166287 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1080f-d7f1-4bd7-a594-0055872f4cca None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:33.203903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fb45b-37c1-4dce-841d-32c906096dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:33.204565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb45b-37c1-4dce-841d-32c906096dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:33.204843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb45b-37c1-4dce-841d-32c906096dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:33.205120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb45b-37c1-4dce-841d-32c906096dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:33.279112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fb45b-37c1-4dce-841d-32c906096dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:33.280567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fb45b-37c1-4dce-841d-32c906096dc4 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:33.370645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:33.381594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 520/1051] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 17:00:33.387527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:33.411455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:33.495091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7074eca-f4dd-4d40-9dd6-c8640885dc94 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:33.529781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80af64-e518-410a-8133-d88f1f36a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:33.530678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80af64-e518-410a-8133-d88f1f36a79d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:33.530950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80af64-e518-410a-8133-d88f1f36a79d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:33.531223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80af64-e518-410a-8133-d88f1f36a79d None admin] PATH_INFO: `/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:33.532435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80af64-e518-410a-8133-d88f1f36a79d None admin] RBAC: Authorizing `identity:get_project(project_id=91d3bddf973c46fc97a4653bbfaf50ec)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:33.533891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80af64-e518-410a-8133-d88f1f36a79d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:33.536078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 532/1052] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:00:33 2022] GET /identity/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:33.541931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fb45b-37c1-4dce-841d-32c906096dc4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:33.642258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fb45b-37c1-4dce-841d-32c906096dc4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:33.677143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f244f-c786-48a1-bcbb-cec1034f601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:33.677823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f244f-c786-48a1-bcbb-cec1034f601d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:33.678102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f244f-c786-48a1-bcbb-cec1034f601d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:33.678375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f244f-c786-48a1-bcbb-cec1034f601d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:33.679200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f244f-c786-48a1-bcbb-cec1034f601d None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=91d3bddf973c46fc97a4653bbfaf50ec, user.id=453486db3dd14260a0787437544f392e) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:33.679506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f244f-c786-48a1-bcbb-cec1034f601d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:33.680940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f244f-c786-48a1-bcbb-cec1034f601d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:33.694762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 521/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:33 2022] GET /identity/v3/role_assignments?user.id=453486db3dd14260a0787437544f392e&scope.project.id=91d3bddf973c46fc97a4653bbfaf50ec&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:33.808143 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6310-2210-438b-a05a-793304ea44d0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:33.808426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6310-2210-438b-a05a-793304ea44d0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:33.808703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6310-2210-438b-a05a-793304ea44d0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:33.810160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 533/1054] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:33.816090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06de8-9e0b-4b7d-a3b0-6f7d3b78d0d2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:33.816377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06de8-9e0b-4b7d-a3b0-6f7d3b78d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:33.816657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b06de8-9e0b-4b7d-a3b0-6f7d3b78d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:33.835224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-80b06de8-9e0b-4b7d-a3b0-6f7d3b78d0d2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:33.836450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-80b06de8-9e0b-4b7d-a3b0-6f7d3b78d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:33.889501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:33.909260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 522/1055] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:33.932083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa6310-2210-438b-a05a-793304ea44d0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:34.024555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:34.038762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa6310-2210-438b-a05a-793304ea44d0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:34.072426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:34.073230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:34.073508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:34.073782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:34.074472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:34.075832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:34.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:34.088868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:34.095062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 534/1056] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jun 23 17:00:33 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:34.095955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b06de8-9e0b-4b7d-a3b0-6f7d3b78d0d2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:34.198315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b06de8-9e0b-4b7d-a3b0-6f7d3b78d0d2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:34.234808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:34.235845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:34.236241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:34.236622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:34.237770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:34.238281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:34.240467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:34.253519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 523/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:34.254990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:34.360635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192f20c-5fed-4348-9920-9119b63eebd3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:34.394659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220f86e-73c8-4d66-bf25-66fcf9262f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:34.395331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f86e-73c8-4d66-bf25-66fcf9262f00 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:34.395599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f86e-73c8-4d66-bf25-66fcf9262f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:34.395885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f86e-73c8-4d66-bf25-66fcf9262f00 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:34.396599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220f86e-73c8-4d66-bf25-66fcf9262f00 None admin] RBAC: Adding query filter params (type=image) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:34.396908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220f86e-73c8-4d66-bf25-66fcf9262f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:34.398325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220f86e-73c8-4d66-bf25-66fcf9262f00 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:34.403502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 535/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:34.409184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:34.460195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:34.511496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab27339-04c6-4171-8199-394ac034d5f9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:34.545024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257147-5d75-4ea2-9016-ad1f9af9ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:34.545682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257147-5d75-4ea2-9016-ad1f9af9ff8c None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:34.545996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257147-5d75-4ea2-9016-ad1f9af9ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:34.546278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257147-5d75-4ea2-9016-ad1f9af9ff8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:34.547024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257147-5d75-4ea2-9016-ad1f9af9ff8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:34.548405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257147-5d75-4ea2-9016-ad1f9af9ff8c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:34.568491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 524/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:00:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:35.156024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93fba-eaee-4e0d-bf92-02a122957d31 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.156392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93fba-eaee-4e0d-bf92-02a122957d31 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.156581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93fba-eaee-4e0d-bf92-02a122957d31 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:35.158196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 536/1060] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:35.163427 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7bcc3-2a2f-4d60-b962-c6f33a234b76 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.163920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7bcc3-2a2f-4d60-b962-c6f33a234b76 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.163998 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7bcc3-2a2f-4d60-b962-c6f33a234b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:35.181064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f6f7bcc3-2a2f-4d60-b962-c6f33a234b76 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:35.182282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f6f7bcc3-2a2f-4d60-b962-c6f33a234b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:35.260514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 525/1061] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:35.282716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d93fba-eaee-4e0d-bf92-02a122957d31 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:35.303465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:35.389672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d93fba-eaee-4e0d-bf92-02a122957d31 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:35.425202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fb6d6-8f5b-4f2b-b37b-46c20d1b74f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:35.425995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fb6d6-8f5b-4f2b-b37b-46c20d1b74f6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.426288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fb6d6-8f5b-4f2b-b37b-46c20d1b74f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.426562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fb6d6-8f5b-4f2b-b37b-46c20d1b74f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:35.438124 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fb6d6-8f5b-4f2b-b37b-46c20d1b74f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-2a5fb6d6-8f5b-4f2b-b37b-46c20d1b74f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:35.446389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:35.447487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:35.448412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:35.453097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 537/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 23 17:00:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:35.454333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7bcc3-2a2f-4d60-b962-c6f33a234b76 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:35.487670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:35.560510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7bcc3-2a2f-4d60-b962-c6f33a234b76 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:35.600717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ce69-e7b6-4f41-a339-e6c048c7fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:35.601392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ce69-e7b6-4f41-a339-e6c048c7fb16 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.601667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ce69-e7b6-4f41-a339-e6c048c7fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.601982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ce69-e7b6-4f41-a339-e6c048c7fb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:35.602727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189ce69-e7b6-4f41-a339-e6c048c7fb16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:35.603032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189ce69-e7b6-4f41-a339-e6c048c7fb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:35.604396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189ce69-e7b6-4f41-a339-e6c048c7fb16 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:35.621050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 526/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 23 17:00:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:35.622563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fb6d6-8f5b-4f2b-b37b-46c20d1b74f6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:35.712981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:35.717766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988fb1-48f9-4894-9ed6-7e01c5f8ef41 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.718226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988fb1-48f9-4894-9ed6-7e01c5f8ef41 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.718433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988fb1-48f9-4894-9ed6-7e01c5f8ef41 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:35.719925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 527/1064] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:35.725724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e233-447a-4681-8b12-bf5b85b68080 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.726061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e233-447a-4681-8b12-bf5b85b68080 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.726319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e233-447a-4681-8b12-bf5b85b68080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:35.740686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fb6d6-8f5b-4f2b-b37b-46c20d1b74f6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:35.743525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-5381e233-447a-4681-8b12-bf5b85b68080 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:35.744725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5381e233-447a-4681-8b12-bf5b85b68080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:35.782474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:35.783291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.783566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.783834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:35.794708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:35.796170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:35.814589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:35.815734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:35.816732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:35.816732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:35.816732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:35.816732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:35.816732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 538/1065] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:35.817633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 528/1066] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:35.826214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:35.841335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e233-447a-4681-8b12-bf5b85b68080 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:35.866818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:35.926988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df204b0-b3c4-4ed1-8545-e21710422d81 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:35.951661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e233-447a-4681-8b12-bf5b85b68080 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:35.952901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:35.961416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:35.962110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.962393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.962663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:35.963389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:35.963695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:35.965073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:35.977157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 539/1067] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:35.982728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:35.993996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a03d-f67e-4f90-a85f-a667a3c38140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:35.994914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a03d-f67e-4f90-a85f-a667a3c38140 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:35.995201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a03d-f67e-4f90-a85f-a667a3c38140 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:35.995467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a03d-f67e-4f90-a85f-a667a3c38140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.005745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105a03d-f67e-4f90-a85f-a667a3c38140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-9105a03d-f67e-4f90-a85f-a667a3c38140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:36.013840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:36.014802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:36.015769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 529/1068] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:36.021462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a03d-f67e-4f90-a85f-a667a3c38140 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.089945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685fea8-4b61-4fcb-adfd-031a72c2ba5d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.105015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:36.123966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a03d-f67e-4f90-a85f-a667a3c38140 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.127802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.128780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.129066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.129340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.137153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.138632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:36.153964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:36.155001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:36.156840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 540/1069] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 17:00:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:36.160137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.160451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.160733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.160931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.161156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.161951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:36.162262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.163646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.173577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 530/1070] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:36.180372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.217660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:36.273645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a6c57-21ba-4a70-ab9c-20c06d356024 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.287733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99634-2c30-4fd2-9d29-546076afd6a5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.309398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.310096 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.310375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.310659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.311487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:36.311789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.313218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.324557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853a1c-9d82-4b45-ba5b-74b9f56b93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.325455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853a1c-9d82-4b45-ba5b-74b9f56b93cb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.325734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853a1c-9d82-4b45-ba5b-74b9f56b93cb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.326039 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853a1c-9d82-4b45-ba5b-74b9f56b93cb None admin] PATH_INFO: `/v3/users/453486db3dd14260a0787437544f392e` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.327604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8853a1c-9d82-4b45-ba5b-74b9f56b93cb None admin] RBAC: Authorizing `identity:get_user(user_id=453486db3dd14260a0787437544f392e)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.329059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8853a1c-9d82-4b45-ba5b-74b9f56b93cb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.335496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 531/1071] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/users/453486db3dd14260a0787437544f392e => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:36.335645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 541/1072] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:36.336403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853a1c-9d82-4b45-ba5b-74b9f56b93cb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.337994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.351820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:36.437734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853a1c-9d82-4b45-ba5b-74b9f56b93cb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.461866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d354daa-87b8-4702-b2dc-591d0c1d6285 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.470926 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:36.476264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02ff88-6782-4c4a-95a4-e9524f477a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.477145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ff88-6782-4c4a-95a4-e9524f477a1d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.477425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ff88-6782-4c4a-95a4-e9524f477a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.477697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ff88-6782-4c4a-95a4-e9524f477a1d None admin] PATH_INFO: `/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.478898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02ff88-6782-4c4a-95a4-e9524f477a1d None admin] RBAC: Authorizing `identity:get_project(project_id=91d3bddf973c46fc97a4653bbfaf50ec)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.480344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02ff88-6782-4c4a-95a4-e9524f477a1d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.482099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 532/1073] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:36.488097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02ff88-6782-4c4a-95a4-e9524f477a1d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.513126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.514002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.514281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.514575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.525688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.527165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:36.544664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:36.545637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:36.546670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:36.546670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:36.546670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:36.546670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:36.550808 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 542/1074] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:36.551565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.583507 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:36.606367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02ff88-6782-4c4a-95a4-e9524f477a1d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.644306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926026b2-6038-46da-b04c-8f1e89e9eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.645205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926026b2-6038-46da-b04c-8f1e89e9eec9 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.645479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926026b2-6038-46da-b04c-8f1e89e9eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.645746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926026b2-6038-46da-b04c-8f1e89e9eec9 None admin] PATH_INFO: `/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec/users/453486db3dd14260a0787437544f392e/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.647709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926026b2-6038-46da-b04c-8f1e89e9eec9 None admin] RBAC: Authorizing `identity:create_grant(project_id=91d3bddf973c46fc97a4653bbfaf50ec, user_id=453486db3dd14260a0787437544f392e, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.649149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926026b2-6038-46da-b04c-8f1e89e9eec9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.657463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6148-a6d2-4924-a606-c4e647e31c53 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.663930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 533/1075] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:00:36 2022] PUT /identity/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec/users/453486db3dd14260a0787437544f392e/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:00:36.665175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95009-7d2a-44a3-b4a5-22fc3a78598b None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.665457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95009-7d2a-44a3-b4a5-22fc3a78598b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.665731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea95009-7d2a-44a3-b4a5-22fc3a78598b None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.667043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 534/1076] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:36.672794 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3256bb-9df8-47b3-80f9-2648ae0f810b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.673073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3256bb-9df8-47b3-80f9-2648ae0f810b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.673350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3256bb-9df8-47b3-80f9-2648ae0f810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.694845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2f3256bb-9df8-47b3-80f9-2648ae0f810b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:36.696147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2f3256bb-9df8-47b3-80f9-2648ae0f810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:36.710254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.710790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.711041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.711329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.712070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:36.712409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.713766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.727984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 543/1077] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:36.733855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.759800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:36.778612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 535/1078] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:36.802110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3256bb-9df8-47b3-80f9-2648ae0f810b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.849454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b353d1-4025-4b15-b764-84284345a359 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.884020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:36.884621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.885425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.885705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.886022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.893054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:36.894622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:36.908798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:36.909812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:36.910849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:36.910849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:36.910849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:36.910849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:36.910849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:36.910849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:36.910849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:36.910849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:36.913191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 544/1079] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:36.916463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:36.923153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3256bb-9df8-47b3-80f9-2648ae0f810b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:36.960644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e548087-8e87-493c-8d83-59453ddee637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:36.961308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e548087-8e87-493c-8d83-59453ddee637 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:36.961594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e548087-8e87-493c-8d83-59453ddee637 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:36.961900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e548087-8e87-493c-8d83-59453ddee637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:36.998834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:37.022311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aabd0-055d-41df-87e2-b8d8740be2f4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:37.029841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e548087-8e87-493c-8d83-59453ddee637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:37.031314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e548087-8e87-493c-8d83-59453ddee637 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:37.063419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:37.064090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:37.064371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:37.064653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:37.065569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:37.065976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:37.067424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:37.085159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 545/1080] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:37.086570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:37.116248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:37.152590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 536/1081] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 17:00:37.158314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e548087-8e87-493c-8d83-59453ddee637 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:37.197721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f0c95-9ba6-4bd6-8dee-15237d32764f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:37.235496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367d302-7bea-4ab7-82af-98c7fc0e98af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:37.236411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367d302-7bea-4ab7-82af-98c7fc0e98af None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:37.237179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367d302-7bea-4ab7-82af-98c7fc0e98af None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:37.237387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367d302-7bea-4ab7-82af-98c7fc0e98af None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/10b3274005534830b0768b122769dd1a/roles/1ba2d60a4f5e4f23bcc0141c58e7362d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:37.240161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367d302-7bea-4ab7-82af-98c7fc0e98af None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=10b3274005534830b0768b122769dd1a, role_id=1ba2d60a4f5e4f23bcc0141c58e7362d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:37.241623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367d302-7bea-4ab7-82af-98c7fc0e98af None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:37.252802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:37.264182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e548087-8e87-493c-8d83-59453ddee637 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:37.266101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 546/1082] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:00:37 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/10b3274005534830b0768b122769dd1a/roles/1ba2d60a4f5e4f23bcc0141c58e7362d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:00:37.304099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a3957-cafe-4771-b467-7ce2d70e83cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:37.304922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a3957-cafe-4771-b467-7ce2d70e83cd None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:37.305200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a3957-cafe-4771-b467-7ce2d70e83cd None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:37.305470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a3957-cafe-4771-b467-7ce2d70e83cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:37.318302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a3957-cafe-4771-b467-7ce2d70e83cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:37.319796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a3957-cafe-4771-b467-7ce2d70e83cd None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-8d3a3957-cafe-4771-b467-7ce2d70e83cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:37.340196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:37.341222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:37.347963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:37.347963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:37.347963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:37.347963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:37.347963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 537/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:37.348256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367d302-7bea-4ab7-82af-98c7fc0e98af None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:37.461183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367d302-7bea-4ab7-82af-98c7fc0e98af None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:37.497102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9e92-39ee-4b22-acff-7bc0b0fd9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:37.497928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9e92-39ee-4b22-acff-7bc0b0fd9a93 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:37.498098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9e92-39ee-4b22-acff-7bc0b0fd9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:37.498331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9e92-39ee-4b22-acff-7bc0b0fd9a93 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:37.499054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9e92-39ee-4b22-acff-7bc0b0fd9a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:37.499356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9e92-39ee-4b22-acff-7bc0b0fd9a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:37.500716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9e92-39ee-4b22-acff-7bc0b0fd9a93 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:37.512835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 547/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:38.662170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caa39c-97b9-4fc3-bafc-d28d03bb5dd7 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:38.662775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caa39c-97b9-4fc3-bafc-d28d03bb5dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:38.662775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caa39c-97b9-4fc3-bafc-d28d03bb5dd7 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:38.664124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 538/1085] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:38.669435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab78b-5a1a-4aab-a654-9e0442453047 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:38.669875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab78b-5a1a-4aab-a654-9e0442453047 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:38.669988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab78b-5a1a-4aab-a654-9e0442453047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:38.687159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-af8ab78b-5a1a-4aab-a654-9e0442453047 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:38.687776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-af8ab78b-5a1a-4aab-a654-9e0442453047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:38.743397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:38.757626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 548/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:38.780864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9caa39c-97b9-4fc3-bafc-d28d03bb5dd7 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:38.808282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:38.890192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9caa39c-97b9-4fc3-bafc-d28d03bb5dd7 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:38.925496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e164-1d81-413b-a345-214bcb9fb601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:38.926247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e164-1d81-413b-a345-214bcb9fb601 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:38.926531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e164-1d81-413b-a345-214bcb9fb601 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:38.926802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e164-1d81-413b-a345-214bcb9fb601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:38.936962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0e164-1d81-413b-a345-214bcb9fb601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-d6a0e164-1d81-413b-a345-214bcb9fb601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:38.944885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:38.945862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:38.946726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 539/1087] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:38.952961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ab78b-5a1a-4aab-a654-9e0442453047 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:39.057591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ab78b-5a1a-4aab-a654-9e0442453047 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:39.092540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:39.093208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.093487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.093759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.094551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:39.094855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:39.096226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:39.104924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 549/1088] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:39.110799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e164-1d81-413b-a345-214bcb9fb601 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:39.195570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:39.214283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e164-1d81-413b-a345-214bcb9fb601 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:39.246742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201960f7-caf2-43d6-8e96-c1fd46de243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:39.247617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201960f7-caf2-43d6-8e96-c1fd46de243d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.247893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201960f7-caf2-43d6-8e96-c1fd46de243d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.248150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201960f7-caf2-43d6-8e96-c1fd46de243d None admin] PATH_INFO: `/v3/users/453486db3dd14260a0787437544f392e` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.249372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201960f7-caf2-43d6-8e96-c1fd46de243d None admin] RBAC: Authorizing `identity:get_user(user_id=453486db3dd14260a0787437544f392e)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:39.250838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201960f7-caf2-43d6-8e96-c1fd46de243d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:39.252449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 540/1089] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:39 2022] GET /identity/v3/users/453486db3dd14260a0787437544f392e => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:39.258443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:39.288927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523589f-3dfc-467a-b8bd-f275d7430dcc None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.289218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523589f-3dfc-467a-b8bd-f275d7430dcc None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.289481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523589f-3dfc-467a-b8bd-f275d7430dcc None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.290848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 541/1090] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:00:39.295616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0b6c7-cb16-45ee-b474-ab824a89d496 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.295894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0b6c7-cb16-45ee-b474-ab824a89d496 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.296163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0b6c7-cb16-45ee-b474-ab824a89d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.311889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:39.312605 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-6eb0b6c7-cb16-45ee-b474-ab824a89d496 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:39.313810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6eb0b6c7-cb16-45ee-b474-ab824a89d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:39.362997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdf7c9-7eaa-443a-a7cb-ca4a9919329f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:39.381722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 542/1091] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:39.399719 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ca7bd-7cfd-4ee0-b7b1-07e0bdd3229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:39.400365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ca7bd-7cfd-4ee0-b7b1-07e0bdd3229b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.400649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ca7bd-7cfd-4ee0-b7b1-07e0bdd3229b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.400918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ca7bd-7cfd-4ee0-b7b1-07e0bdd3229b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.405513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0b6c7-cb16-45ee-b474-ab824a89d496 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:39.468754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ca7bd-7cfd-4ee0-b7b1-07e0bdd3229b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:39.470161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ca7bd-7cfd-4ee0-b7b1-07e0bdd3229b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:39.484863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:39.506603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0b6c7-cb16-45ee-b474-ab824a89d496 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:39.519973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:39.540021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31681e-db84-463e-b4cf-c6b88549efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:39.540852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31681e-db84-463e-b4cf-c6b88549efd7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.541134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31681e-db84-463e-b4cf-c6b88549efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.541411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31681e-db84-463e-b4cf-c6b88549efd7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.551876 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31681e-db84-463e-b4cf-c6b88549efd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-6e31681e-db84-463e-b4cf-c6b88549efd7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:39.560053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:39.561092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:39.561983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 543/1092] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jun 23 17:00:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:00:39.567458 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31681e-db84-463e-b4cf-c6b88549efd7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:39.573100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 550/1093] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 17:00:39.579084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ca7bd-7cfd-4ee0-b7b1-07e0bdd3229b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:39.667762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31681e-db84-463e-b4cf-c6b88549efd7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:39.675908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ca7bd-7cfd-4ee0-b7b1-07e0bdd3229b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:39.703021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:39.703721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.703995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.704267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.705017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:39.705324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:39.706744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:39.712751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b99776-e8a8-463e-a733-28e2ffe75d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:39.713622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99776-e8a8-463e-a733-28e2ffe75d5b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.713930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99776-e8a8-463e-a733-28e2ffe75d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.714204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b99776-e8a8-463e-a733-28e2ffe75d5b None admin] PATH_INFO: `/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.714856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 544/1094] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 23 17:00:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:39.715375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99776-e8a8-463e-a733-28e2ffe75d5b None admin] RBAC: Authorizing `identity:get_project(project_id=91d3bddf973c46fc97a4653bbfaf50ec)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:39.716788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b99776-e8a8-463e-a733-28e2ffe75d5b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:39.718516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 551/1095] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:00:39 2022] GET /identity/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:39.724340 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:39.724744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b99776-e8a8-463e-a733-28e2ffe75d5b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:39.727240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:39.744370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:39.825875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b99776-e8a8-463e-a733-28e2ffe75d5b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:39.836583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a7f42-082b-45b8-9689-1b9450856fa8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:39.860099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:39.860760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.861045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.861319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.862325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=91d3bddf973c46fc97a4653bbfaf50ec, user.id=453486db3dd14260a0787437544f392e) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:39.862772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:39.864329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:39.870269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 552/1096] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:39 2022] GET /identity/v3/role_assignments?user.id=453486db3dd14260a0787437544f392e&scope.project.id=91d3bddf973c46fc97a4653bbfaf50ec&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:00:39.870751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:39.871556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:39.871842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:39.872119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:39.884390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:39.885938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:39.905333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:39.906447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:39.907403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:39.907403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:39.907403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:39.907403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:39.907403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 545/1097] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:39.913010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:40.001730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:40.022383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d539442-5bf9-476a-8ef9-e9c9324420d4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:40.063256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:40.063925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:40.064203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:40.064467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:40.065255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:40.065561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:40.066952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:40.079082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 553/1098] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:40.085065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:40.140815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:40.187063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46070186-8169-4382-a0a4-45359bc2075d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:40.222315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:40.223115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:40.223396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:40.223665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:40.231560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:40.233004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:00:40.247246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:40.248227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:40.249192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 546/1099] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jun 23 17:00:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:40.254615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:40.359788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40968-791c-48a5-83a4-a463cb53f559 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:40.396158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:40.396831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:40.397114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:40.397387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:40.398264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:40.398576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:40.400008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:40.414218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:40.418545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 554/1100] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jun 23 17:00:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:40.423880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:40.521970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76791198-70b5-4ac2-8385-a9c887b4ff5d None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:40.535983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:40.557579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626d1bf-ea13-4d9d-963c-befae15772c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:40.558255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626d1bf-ea13-4d9d-963c-befae15772c5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:40.558533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626d1bf-ea13-4d9d-963c-befae15772c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:40.558807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626d1bf-ea13-4d9d-963c-befae15772c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:40.628778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626d1bf-ea13-4d9d-963c-befae15772c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:40.630331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626d1bf-ea13-4d9d-963c-befae15772c5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:40.735764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 547/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:00:40.741705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:40.841179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ec6dd-1e0f-4b81-bff5-df4dfbcdf2fe None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:40.875695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:40.876485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:40.876760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:40.877031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:40.887194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:40.888624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:00:40.906803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:40.907713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:40.908617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:00:40.908617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:00:40.908617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:00:40.908617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:40.908617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 555/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:40.914365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626d1bf-ea13-4d9d-963c-befae15772c5 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:40.931832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:41.018723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626d1bf-ea13-4d9d-963c-befae15772c5 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:41.055037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:41.055691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:41.055969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:41.056233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:41.056943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:41.057239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:41.058647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:41.070189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 548/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:41.075957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:41.128796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:41.206184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080efde-5de8-4808-83e7-b1c39a1ea3fc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:41.262782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:41.264146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:41.264645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:41.265132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:41.276667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:41.279398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:00:41.305040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:41.306077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:41.307187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:00:41.307187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:00:41.307187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:00:41.307187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:00:41.307187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:00:41.307187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:00:41.307187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:00:41.307187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:00:41.307828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 556/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:41.313148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:41.392879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:41.419272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca990a-4cb6-46fc-99b5-f9b45e5f2e16 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:41.454798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72617e7d-de5b-4d3d-ac4e-21c761492309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:41.455520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72617e7d-de5b-4d3d-ac4e-21c761492309 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:41.455902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72617e7d-de5b-4d3d-ac4e-21c761492309 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:41.456226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72617e7d-de5b-4d3d-ac4e-21c761492309 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:41.457006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72617e7d-de5b-4d3d-ac4e-21c761492309 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:41.457311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72617e7d-de5b-4d3d-ac4e-21c761492309 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:41.458782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72617e7d-de5b-4d3d-ac4e-21c761492309 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:41.471658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 549/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:41.477926 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:41.583180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972c25-da2b-4a42-9ac4-e05e1a498afb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:41.596058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:41.618193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808828e4-7b97-413e-a736-88257a10f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:41.618846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808828e4-7b97-413e-a736-88257a10f141 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:41.619124 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808828e4-7b97-413e-a736-88257a10f141 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:41.619393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808828e4-7b97-413e-a736-88257a10f141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:41.620220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808828e4-7b97-413e-a736-88257a10f141 None admin] RBAC: Adding query filter params (role.id=1ba2d60a4f5e4f23bcc0141c58e7362d, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=10b3274005534830b0768b122769dd1a) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:41.620525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808828e4-7b97-413e-a736-88257a10f141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:41.621983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808828e4-7b97-413e-a736-88257a10f141 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:41.627809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 557/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:41 2022] GET /identity/v3/role_assignments?user.id=10b3274005534830b0768b122769dd1a&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=1ba2d60a4f5e4f23bcc0141c58e7362d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:42.001239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29614d3a-73e7-48ae-9954-f0d7a2a64c1a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:42.001752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29614d3a-73e7-48ae-9954-f0d7a2a64c1a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:42.001752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29614d3a-73e7-48ae-9954-f0d7a2a64c1a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:42.003820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 550/1107] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:42.009341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060f78-46c9-4688-8a35-eeba0ee16802 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:42.009760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060f78-46c9-4688-8a35-eeba0ee16802 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:42.009928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060f78-46c9-4688-8a35-eeba0ee16802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:42.028458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9b060f78-46c9-4688-8a35-eeba0ee16802 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:42.029701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9b060f78-46c9-4688-8a35-eeba0ee16802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:42.099168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 558/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:42.124141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29614d3a-73e7-48ae-9954-f0d7a2a64c1a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:42.226838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29614d3a-73e7-48ae-9954-f0d7a2a64c1a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:42.265142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72aee0-5808-424f-9687-659899526a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:42.265899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72aee0-5808-424f-9687-659899526a9b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:42.266183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72aee0-5808-424f-9687-659899526a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:42.266458 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72aee0-5808-424f-9687-659899526a9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:42.267628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72aee0-5808-424f-9687-659899526a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:42.269140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72aee0-5808-424f-9687-659899526a9b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:42.272794 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 551/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:42.276707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b060f78-46c9-4688-8a35-eeba0ee16802 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:42.379621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b060f78-46c9-4688-8a35-eeba0ee16802 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:42.387358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:42.415935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa475ca-1197-4137-83ea-cd8af68b1831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:42.416608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa475ca-1197-4137-83ea-cd8af68b1831 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:42.416885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa475ca-1197-4137-83ea-cd8af68b1831 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:42.417154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa475ca-1197-4137-83ea-cd8af68b1831 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:42.417913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa475ca-1197-4137-83ea-cd8af68b1831 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:42.419345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa475ca-1197-4137-83ea-cd8af68b1831 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:42.440950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 559/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 17:00:42 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:44.489609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe0fb-683d-416d-b1bf-5db21aecdf77 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:44.490493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe0fb-683d-416d-b1bf-5db21aecdf77 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:44.490493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe0fb-683d-416d-b1bf-5db21aecdf77 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:44.492754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 552/1111] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:44.498318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce95e-ab4f-4f72-8d39-e2b331676880 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:44.498738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce95e-ab4f-4f72-8d39-e2b331676880 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:44.498845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bce95e-ab4f-4f72-8d39-e2b331676880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:44.517434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-06bce95e-ab4f-4f72-8d39-e2b331676880 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:44.518882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-06bce95e-ab4f-4f72-8d39-e2b331676880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:44.587675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 560/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 17:00:44.611513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe0fb-683d-416d-b1bf-5db21aecdf77 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:44.615584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:44.728981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe0fb-683d-416d-b1bf-5db21aecdf77 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:44.763616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8d33-7e95-4e7e-819e-27287d99938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:44.764405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8d33-7e95-4e7e-819e-27287d99938b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:44.764681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8d33-7e95-4e7e-819e-27287d99938b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:44.764956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8d33-7e95-4e7e-819e-27287d99938b None admin] PATH_INFO: `/v3/roles/de3989d133584bab8378c170cee57ac6` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:44.766497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8d33-7e95-4e7e-819e-27287d99938b None admin] RBAC: Authorizing `identity:get_role(role_id=de3989d133584bab8378c170cee57ac6)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:44.767871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f8d33-7e95-4e7e-819e-27287d99938b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:44.769422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 553/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:44 2022] GET /identity/v3/roles/de3989d133584bab8378c170cee57ac6 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:44.775690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce95e-ab4f-4f72-8d39-e2b331676880 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:44.868193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:44.879933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bce95e-ab4f-4f72-8d39-e2b331676880 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:44.918802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c77907-e475-4656-9f48-c47efb658894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:44.919671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77907-e475-4656-9f48-c47efb658894 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:44.919946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77907-e475-4656-9f48-c47efb658894 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:44.920216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77907-e475-4656-9f48-c47efb658894 None admin] PATH_INFO: `/v3/users/ebf6974f7562487d96e30c02fec9078f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:44.933478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c77907-e475-4656-9f48-c47efb658894 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf6974f7562487d96e30c02fec9078f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:44.934948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c77907-e475-4656-9f48-c47efb658894 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:44.936574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 561/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:44 2022] GET /identity/v3/users/ebf6974f7562487d96e30c02fec9078f => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:44.943890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8d33-7e95-4e7e-819e-27287d99938b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:45.014944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:45.048426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8d33-7e95-4e7e-819e-27287d99938b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:45.087515 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0338b-eda6-4ed1-a9d3-a8f5a7655945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:45.088162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0338b-eda6-4ed1-a9d3-a8f5a7655945 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:45.088442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0338b-eda6-4ed1-a9d3-a8f5a7655945 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:45.088717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0338b-eda6-4ed1-a9d3-a8f5a7655945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:45.157785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0338b-eda6-4ed1-a9d3-a8f5a7655945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:45.159319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0338b-eda6-4ed1-a9d3-a8f5a7655945 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:45.229726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:45.262512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 554/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:00:45.270926 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c77907-e475-4656-9f48-c47efb658894 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:45.376786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c77907-e475-4656-9f48-c47efb658894 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:45.414199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc45b6-5467-4038-ac8a-eccb7fa9cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:45.415050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc45b6-5467-4038-ac8a-eccb7fa9cddf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:45.415325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc45b6-5467-4038-ac8a-eccb7fa9cddf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:45.415591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc45b6-5467-4038-ac8a-eccb7fa9cddf None admin] PATH_INFO: `/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:45.417214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc45b6-5467-4038-ac8a-eccb7fa9cddf None admin] RBAC: Authorizing `identity:get_project(project_id=91d3bddf973c46fc97a4653bbfaf50ec)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:45.418670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc45b6-5467-4038-ac8a-eccb7fa9cddf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:45.420347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 562/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:00:45 2022] GET /identity/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:45.427508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0338b-eda6-4ed1-a9d3-a8f5a7655945 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:45.546655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0338b-eda6-4ed1-a9d3-a8f5a7655945 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:45.587304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc578ceb-5eea-44b0-b20e-206b958998f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:45.588023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578ceb-5eea-44b0-b20e-206b958998f6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:45.588302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578ceb-5eea-44b0-b20e-206b958998f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:45.588579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc578ceb-5eea-44b0-b20e-206b958998f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:45.589404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc578ceb-5eea-44b0-b20e-206b958998f6 None admin] RBAC: Adding query filter params (role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=91d3bddf973c46fc97a4653bbfaf50ec, user.id=ebf6974f7562487d96e30c02fec9078f) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:45.589717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc578ceb-5eea-44b0-b20e-206b958998f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:45.591186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc578ceb-5eea-44b0-b20e-206b958998f6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:45.597364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 555/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:45 2022] GET /identity/v3/role_assignments?user.id=ebf6974f7562487d96e30c02fec9078f&scope.project.id=91d3bddf973c46fc97a4653bbfaf50ec&role.id=de3989d133584bab8378c170cee57ac6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:47.580244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329fcbb-0da8-4fe4-aa94-37033705bb81 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:47.581531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329fcbb-0da8-4fe4-aa94-37033705bb81 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:47.581531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329fcbb-0da8-4fe4-aa94-37033705bb81 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:47.583557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 563/1118] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:47.592606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8eecb-2137-46ae-babe-08f2dae4438e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:47.593335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8eecb-2137-46ae-babe-08f2dae4438e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:47.593501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8eecb-2137-46ae-babe-08f2dae4438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:47.618528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-77f8eecb-2137-46ae-babe-08f2dae4438e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:47.619735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-77f8eecb-2137-46ae-babe-08f2dae4438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:47.648619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:47.692860 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 556/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:47.716544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329fcbb-0da8-4fe4-aa94-37033705bb81 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:47.738212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:47.839835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329fcbb-0da8-4fe4-aa94-37033705bb81 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:47.878937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5da53-e382-404b-a517-2ff4dbbd639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:47.879789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5da53-e382-404b-a517-2ff4dbbd639e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:47.880066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5da53-e382-404b-a517-2ff4dbbd639e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:47.880336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5da53-e382-404b-a517-2ff4dbbd639e None admin] PATH_INFO: `/v3/roles/de3989d133584bab8378c170cee57ac6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:47.881939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5da53-e382-404b-a517-2ff4dbbd639e None admin] RBAC: Authorizing `identity:get_role(role_id=de3989d133584bab8378c170cee57ac6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:47.883303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5da53-e382-404b-a517-2ff4dbbd639e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:47.884656 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 564/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:47 2022] GET /identity/v3/roles/de3989d133584bab8378c170cee57ac6 => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:47.894080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8eecb-2137-46ae-babe-08f2dae4438e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:48.000907 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8eecb-2137-46ae-babe-08f2dae4438e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:48.035914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ccc2-2e4a-4ba6-ba15-5d907d848174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:48.036788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ccc2-2e4a-4ba6-ba15-5d907d848174 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:48.037059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ccc2-2e4a-4ba6-ba15-5d907d848174 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:48.037330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838ccc2-2e4a-4ba6-ba15-5d907d848174 None admin] PATH_INFO: `/v3/users/ebf6974f7562487d96e30c02fec9078f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:48.038575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ccc2-2e4a-4ba6-ba15-5d907d848174 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf6974f7562487d96e30c02fec9078f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:48.040021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838ccc2-2e4a-4ba6-ba15-5d907d848174 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:48.041643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 557/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:47 2022] GET /identity/v3/users/ebf6974f7562487d96e30c02fec9078f => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:48.047875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5da53-e382-404b-a517-2ff4dbbd639e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:48.139329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:48.156665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5da53-e382-404b-a517-2ff4dbbd639e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:48.193806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04b0a2-8836-4c12-bddd-055051dec5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:48.194682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04b0a2-8836-4c12-bddd-055051dec5cb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:48.194962 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04b0a2-8836-4c12-bddd-055051dec5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:48.195240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04b0a2-8836-4c12-bddd-055051dec5cb None admin] PATH_INFO: `/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:48.196539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04b0a2-8836-4c12-bddd-055051dec5cb None admin] RBAC: Authorizing `identity:get_project(project_id=91d3bddf973c46fc97a4653bbfaf50ec)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:48.198006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04b0a2-8836-4c12-bddd-055051dec5cb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:48.199693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 565/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:00:48 2022] GET /identity/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:48.206403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ccc2-2e4a-4ba6-ba15-5d907d848174 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:48.238797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:48.314310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838ccc2-2e4a-4ba6-ba15-5d907d848174 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:48.351730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b206-4bc4-41e4-b209-4c7eb00587b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:48.352616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b206-4bc4-41e4-b209-4c7eb00587b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:48.352894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b206-4bc4-41e4-b209-4c7eb00587b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:48.353169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b206-4bc4-41e4-b209-4c7eb00587b3 None admin] PATH_INFO: `/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec/users/ebf6974f7562487d96e30c02fec9078f/roles/de3989d133584bab8378c170cee57ac6` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:48.355541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b206-4bc4-41e4-b209-4c7eb00587b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=91d3bddf973c46fc97a4653bbfaf50ec, user_id=ebf6974f7562487d96e30c02fec9078f, role_id=de3989d133584bab8378c170cee57ac6)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:48.356979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173b206-4bc4-41e4-b209-4c7eb00587b3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:48.373010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 558/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:00:48 2022] PUT /identity/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec/users/ebf6974f7562487d96e30c02fec9078f/roles/de3989d133584bab8378c170cee57ac6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:00:50.416725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fab99-5f88-41d2-bc2a-b5a4052c0f19 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:50.417316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fab99-5f88-41d2-bc2a-b5a4052c0f19 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:50.417316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fab99-5f88-41d2-bc2a-b5a4052c0f19 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:50.419468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 566/1124] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:50.427812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c16e-7b1e-4f6b-b568-ea752eda8003 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:50.428290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c16e-7b1e-4f6b-b568-ea752eda8003 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:50.428735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402c16e-7b1e-4f6b-b568-ea752eda8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:50.452782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-8402c16e-7b1e-4f6b-b568-ea752eda8003 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:50.454535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8402c16e-7b1e-4f6b-b568-ea752eda8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:50.537466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 559/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:50.565569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fab99-5f88-41d2-bc2a-b5a4052c0f19 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:50.673487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fab99-5f88-41d2-bc2a-b5a4052c0f19 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:50.710760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335aab94-257b-4b98-acc7-07c7e0d388ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:50.711629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335aab94-257b-4b98-acc7-07c7e0d388ff None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:50.711908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335aab94-257b-4b98-acc7-07c7e0d388ff None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:50.712190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335aab94-257b-4b98-acc7-07c7e0d388ff None admin] PATH_INFO: `/v3/roles/de3989d133584bab8378c170cee57ac6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:50.713708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335aab94-257b-4b98-acc7-07c7e0d388ff None admin] RBAC: Authorizing `identity:get_role(role_id=de3989d133584bab8378c170cee57ac6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:50.715120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335aab94-257b-4b98-acc7-07c7e0d388ff None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:50.716491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 567/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:50 2022] GET /identity/v3/roles/de3989d133584bab8378c170cee57ac6 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:50.723563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402c16e-7b1e-4f6b-b568-ea752eda8003 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:50.760324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:50.864766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402c16e-7b1e-4f6b-b568-ea752eda8003 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:50.908944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eebce3-df07-4379-8a67-3bf8ab0fdea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:50.909840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eebce3-df07-4379-8a67-3bf8ab0fdea7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:50.910120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eebce3-df07-4379-8a67-3bf8ab0fdea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:50.910386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eebce3-df07-4379-8a67-3bf8ab0fdea7 None admin] PATH_INFO: `/v3/users/ebf6974f7562487d96e30c02fec9078f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:50.911570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eebce3-df07-4379-8a67-3bf8ab0fdea7 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf6974f7562487d96e30c02fec9078f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:50.913000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eebce3-df07-4379-8a67-3bf8ab0fdea7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:50.914700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 560/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:50 2022] GET /identity/v3/users/ebf6974f7562487d96e30c02fec9078f => generated 286 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:50.924493 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335aab94-257b-4b98-acc7-07c7e0d388ff None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:50.954782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:51.032618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335aab94-257b-4b98-acc7-07c7e0d388ff None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:51.067929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b61f9-8c99-4922-afa9-ee7bc2e08a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:51.068563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b61f9-8c99-4922-afa9-ee7bc2e08a33 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:51.068834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b61f9-8c99-4922-afa9-ee7bc2e08a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:51.069101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b61f9-8c99-4922-afa9-ee7bc2e08a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:51.146454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b61f9-8c99-4922-afa9-ee7bc2e08a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:51.147922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b61f9-8c99-4922-afa9-ee7bc2e08a33 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:51.173263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:51.257103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 568/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:00:51.263300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eebce3-df07-4379-8a67-3bf8ab0fdea7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:51.354214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:51.364859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eebce3-df07-4379-8a67-3bf8ab0fdea7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:51.400606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d367374-0f64-4914-a280-4c941fd7e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:51.401463 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d367374-0f64-4914-a280-4c941fd7e209 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:51.401746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d367374-0f64-4914-a280-4c941fd7e209 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:51.402045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d367374-0f64-4914-a280-4c941fd7e209 None admin] PATH_INFO: `/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:51.403261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d367374-0f64-4914-a280-4c941fd7e209 None admin] RBAC: Authorizing `identity:get_project(project_id=91d3bddf973c46fc97a4653bbfaf50ec)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:51.404710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d367374-0f64-4914-a280-4c941fd7e209 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:51.406465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 561/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:00:51 2022] GET /identity/v3/projects/91d3bddf973c46fc97a4653bbfaf50ec => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:51.412874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b61f9-8c99-4922-afa9-ee7bc2e08a33 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:51.519193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b61f9-8c99-4922-afa9-ee7bc2e08a33 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:51.542575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:51.555381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81cae5-eddf-435c-9aa4-22a3dfea2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:51.556056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81cae5-eddf-435c-9aa4-22a3dfea2d05 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:51.556320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81cae5-eddf-435c-9aa4-22a3dfea2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:51.556599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81cae5-eddf-435c-9aa4-22a3dfea2d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:51.557431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81cae5-eddf-435c-9aa4-22a3dfea2d05 None admin] RBAC: Adding query filter params (role.id=de3989d133584bab8378c170cee57ac6, scope.project.id=91d3bddf973c46fc97a4653bbfaf50ec, user.id=ebf6974f7562487d96e30c02fec9078f) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:51.557738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81cae5-eddf-435c-9aa4-22a3dfea2d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:51.559221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81cae5-eddf-435c-9aa4-22a3dfea2d05 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:51.565748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 569/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:51 2022] GET /identity/v3/role_assignments?user.id=ebf6974f7562487d96e30c02fec9078f&scope.project.id=91d3bddf973c46fc97a4653bbfaf50ec&role.id=de3989d133584bab8378c170cee57ac6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:53.610513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddfb3b-569a-4728-a94a-e45d1cd59c2c None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:53.611081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddfb3b-569a-4728-a94a-e45d1cd59c2c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:53.611081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddfb3b-569a-4728-a94a-e45d1cd59c2c None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:53.612577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 562/1131] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:53.618991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c1742-86e4-4c73-9b4c-ac945e6693ff None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:53.619746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c1742-86e4-4c73-9b4c-ac945e6693ff None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:53.619867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c1742-86e4-4c73-9b4c-ac945e6693ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:53.648611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e45c1742-86e4-4c73-9b4c-ac945e6693ff None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:53.649840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e45c1742-86e4-4c73-9b4c-ac945e6693ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:53.724609 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 570/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:53.749253 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddfb3b-569a-4728-a94a-e45d1cd59c2c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:53.864848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddfb3b-569a-4728-a94a-e45d1cd59c2c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:53.901164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19da121-b9aa-4071-972e-b3f4f9eba0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:53.902003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19da121-b9aa-4071-972e-b3f4f9eba0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:53.902278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19da121-b9aa-4071-972e-b3f4f9eba0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:53.902553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19da121-b9aa-4071-972e-b3f4f9eba0d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:53.903854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19da121-b9aa-4071-972e-b3f4f9eba0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:53.905313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19da121-b9aa-4071-972e-b3f4f9eba0d5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:53.906982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 563/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:53.916569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c1742-86e4-4c73-9b4c-ac945e6693ff None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:54.027486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c1742-86e4-4c73-9b4c-ac945e6693ff None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:54.044148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:54.063420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77317b-37c1-4f35-81a0-836be1e4adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:54.064073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77317b-37c1-4f35-81a0-836be1e4adec None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:54.064357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77317b-37c1-4f35-81a0-836be1e4adec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:54.064719 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77317b-37c1-4f35-81a0-836be1e4adec None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:54.065422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77317b-37c1-4f35-81a0-836be1e4adec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:54.066890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77317b-37c1-4f35-81a0-836be1e4adec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:54.100137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 571/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:00:53 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:56.140299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0d2b-e93b-400e-8c8f-63438965e699 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:56.141153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0d2b-e93b-400e-8c8f-63438965e699 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:56.141153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0d2b-e93b-400e-8c8f-63438965e699 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:56.143440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 564/1135] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:56.152208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afff99-0f8f-423c-ab64-38f20137e879 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:56.152971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afff99-0f8f-423c-ab64-38f20137e879 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:56.153145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afff99-0f8f-423c-ab64-38f20137e879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:56.173638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e8afff99-0f8f-423c-ab64-38f20137e879 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:56.174860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8afff99-0f8f-423c-ab64-38f20137e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:56.249422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 572/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:56.288274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb0d2b-e93b-400e-8c8f-63438965e699 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:56.320431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:56.406401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb0d2b-e93b-400e-8c8f-63438965e699 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:56.440450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527aebd-37fd-45ad-a45f-2fd1517dc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:56.441235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527aebd-37fd-45ad-a45f-2fd1517dc24a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:56.441514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527aebd-37fd-45ad-a45f-2fd1517dc24a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:56.441786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527aebd-37fd-45ad-a45f-2fd1517dc24a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:56.442993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527aebd-37fd-45ad-a45f-2fd1517dc24a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:56.444444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527aebd-37fd-45ad-a45f-2fd1517dc24a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:56.446108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 565/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:56.452477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afff99-0f8f-423c-ab64-38f20137e879 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:56.551488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:56.557834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afff99-0f8f-423c-ab64-38f20137e879 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:56.604668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8128e1-0a52-4857-84e3-5f73fe50c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:56.605324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8128e1-0a52-4857-84e3-5f73fe50c028 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:56.605598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8128e1-0a52-4857-84e3-5f73fe50c028 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:56.605903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8128e1-0a52-4857-84e3-5f73fe50c028 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:56.606599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8128e1-0a52-4857-84e3-5f73fe50c028 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:56.608034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8128e1-0a52-4857-84e3-5f73fe50c028 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:56.630800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 573/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 17:00:56 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:00:58.685293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac378d1d-89ac-49aa-8c7d-fe379a9a55b7 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:58.685917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac378d1d-89ac-49aa-8c7d-fe379a9a55b7 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:58.685917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac378d1d-89ac-49aa-8c7d-fe379a9a55b7 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:58.687254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 566/1139] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:00:58.693375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964290a-a8ea-482a-a115-1bcdd5e1f21b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:58.693847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964290a-a8ea-482a-a115-1bcdd5e1f21b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:58.693940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964290a-a8ea-482a-a115-1bcdd5e1f21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:58.712311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0964290a-a8ea-482a-a115-1bcdd5e1f21b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:00:58.713482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0964290a-a8ea-482a-a115-1bcdd5e1f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:00:58.782103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 574/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:00:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:00:58.806501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac378d1d-89ac-49aa-8c7d-fe379a9a55b7 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:58.918903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:58.928444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac378d1d-89ac-49aa-8c7d-fe379a9a55b7 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:58.967746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22fc6d-712b-467a-8346-698a03e51ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:58.968452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22fc6d-712b-467a-8346-698a03e51ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:58.968732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22fc6d-712b-467a-8346-698a03e51ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:58.969008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22fc6d-712b-467a-8346-698a03e51ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:58.980967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22fc6d-712b-467a-8346-698a03e51ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-cf22fc6d-712b-467a-8346-698a03e51ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:00:58.988782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:00:58.989841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:00:58.990911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 567/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:00:58.998975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964290a-a8ea-482a-a115-1bcdd5e1f21b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:59.088723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:59.105152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964290a-a8ea-482a-a115-1bcdd5e1f21b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:59.141063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:59.141718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:59.142030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:59.142305 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:59.143082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:59.143390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:59.144768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:59.152902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 575/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:59.159680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22fc6d-712b-467a-8346-698a03e51ed7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:59.276325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22fc6d-712b-467a-8346-698a03e51ed7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:59.318511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdcf4-f625-455f-accd-cd77e883f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:59.319382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdcf4-f625-455f-accd-cd77e883f00f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:59.319663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdcf4-f625-455f-accd-cd77e883f00f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:59.319940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdcf4-f625-455f-accd-cd77e883f00f None admin] PATH_INFO: `/v3/users/1a1b8c547e08431fac65130848ac84c2` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:59.334079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cdcf4-f625-455f-accd-cd77e883f00f None admin] RBAC: Authorizing `identity:get_user(user_id=1a1b8c547e08431fac65130848ac84c2)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:59.335533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cdcf4-f625-455f-accd-cd77e883f00f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:59.337186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 568/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:00:59 2022] GET /identity/v3/users/1a1b8c547e08431fac65130848ac84c2 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:59.346371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:59.463849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38850c9c-8f08-416f-b29a-8a980b3fba32 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:59.497816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6509-af7c-4d61-bceb-4a4c07b6f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:59.498443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6509-af7c-4d61-bceb-4a4c07b6f06e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:59.498721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6509-af7c-4d61-bceb-4a4c07b6f06e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:59.498988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6509-af7c-4d61-bceb-4a4c07b6f06e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:59.514246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:59.566946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e6509-af7c-4d61-bceb-4a4c07b6f06e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:59.568307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e6509-af7c-4d61-bceb-4a4c07b6f06e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:59.667137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 576/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:00:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:00:59.678927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdcf4-f625-455f-accd-cd77e883f00f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:59.696318 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:59.783349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdcf4-f625-455f-accd-cd77e883f00f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:59.828840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7395c-7521-421c-bf92-950b7e3e1984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:59.829646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7395c-7521-421c-bf92-950b7e3e1984 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:59.829970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7395c-7521-421c-bf92-950b7e3e1984 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:59.830240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7395c-7521-421c-bf92-950b7e3e1984 None admin] PATH_INFO: `/v3/projects/f267a58b00ba4a0782e3125f86401b3b` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:59.831613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7395c-7521-421c-bf92-950b7e3e1984 None admin] RBAC: Authorizing `identity:get_project(project_id=f267a58b00ba4a0782e3125f86401b3b)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:59.833057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7395c-7521-421c-bf92-950b7e3e1984 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:59.834808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 569/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:00:59 2022] GET /identity/v3/projects/f267a58b00ba4a0782e3125f86401b3b => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:00:59.841196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6509-af7c-4d61-bceb-4a4c07b6f06e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:00:59.891365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:00:59.951441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6509-af7c-4d61-bceb-4a4c07b6f06e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:00:59.989221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d0807-c68f-4d5f-a610-17c1c29cb4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:00:59.989892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0807-c68f-4d5f-a610-17c1c29cb4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:00:59.990174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0807-c68f-4d5f-a610-17c1c29cb4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:00:59.990481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d0807-c68f-4d5f-a610-17c1c29cb4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:00:59.991291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d0807-c68f-4d5f-a610-17c1c29cb4e0 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=f267a58b00ba4a0782e3125f86401b3b, user.id=1a1b8c547e08431fac65130848ac84c2) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:00:59.991604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d0807-c68f-4d5f-a610-17c1c29cb4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:00:59.993046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d0807-c68f-4d5f-a610-17c1c29cb4e0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:00:59.998711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 577/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:00:59 2022] GET /identity/v3/role_assignments?user.id=1a1b8c547e08431fac65130848ac84c2&scope.project.id=f267a58b00ba4a0782e3125f86401b3b&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:01.977767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27946ac-337f-4ad2-b048-41c0c8e4a1c0 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:01.978328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27946ac-337f-4ad2-b048-41c0c8e4a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:01.978328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27946ac-337f-4ad2-b048-41c0c8e4a1c0 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:01.979645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 570/1147] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:01.986086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9eee6-40d8-46f4-8c18-285fb2a1f3f1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:01.986815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9eee6-40d8-46f4-8c18-285fb2a1f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:01.987164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9eee6-40d8-46f4-8c18-285fb2a1f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:02.010840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a6f9eee6-40d8-46f4-8c18-285fb2a1f3f1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:02.012048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a6f9eee6-40d8-46f4-8c18-285fb2a1f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:02.085255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 578/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:02.113620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27946ac-337f-4ad2-b048-41c0c8e4a1c0 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:02.199265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:02.228479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27946ac-337f-4ad2-b048-41c0c8e4a1c0 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:02.260954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385eff5-07b5-4474-88f8-ff5d285b7bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:02.261742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385eff5-07b5-4474-88f8-ff5d285b7bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:02.262054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385eff5-07b5-4474-88f8-ff5d285b7bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:02.262329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385eff5-07b5-4474-88f8-ff5d285b7bd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:02.274590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385eff5-07b5-4474-88f8-ff5d285b7bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-b385eff5-07b5-4474-88f8-ff5d285b7bd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:01:02.285647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:01:02.286732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:01:02.287969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 571/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:01:02.293618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9eee6-40d8-46f4-8c18-285fb2a1f3f1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:02.354260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:02.422949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9eee6-40d8-46f4-8c18-285fb2a1f3f1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:02.460017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:02.460688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:02.460968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:02.461244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:02.462033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:02.462338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:02.463714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:02.471897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 579/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:02.478020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385eff5-07b5-4474-88f8-ff5d285b7bd9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:02.592371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385eff5-07b5-4474-88f8-ff5d285b7bd9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:02.627169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0256e-cffa-4d6a-be3f-754f7cb115c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:02.628050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0256e-cffa-4d6a-be3f-754f7cb115c7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:02.628324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0256e-cffa-4d6a-be3f-754f7cb115c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:02.628592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0256e-cffa-4d6a-be3f-754f7cb115c7 None admin] PATH_INFO: `/v3/users/1a1b8c547e08431fac65130848ac84c2` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:02.629927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0256e-cffa-4d6a-be3f-754f7cb115c7 None admin] RBAC: Authorizing `identity:get_user(user_id=1a1b8c547e08431fac65130848ac84c2)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:02.631365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0256e-cffa-4d6a-be3f-754f7cb115c7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:02.632977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 572/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:01:02 2022] GET /identity/v3/users/1a1b8c547e08431fac65130848ac84c2 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:02.643147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:02.760085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5127ec-930a-4f7e-94e5-914137d5027a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:02.761638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:02.796710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ac6c9-8b3e-4ff8-9aa2-daeb1cef2b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:02.797575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac6c9-8b3e-4ff8-9aa2-daeb1cef2b8b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:02.797857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac6c9-8b3e-4ff8-9aa2-daeb1cef2b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:02.798163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ac6c9-8b3e-4ff8-9aa2-daeb1cef2b8b None admin] PATH_INFO: `/v3/projects/f267a58b00ba4a0782e3125f86401b3b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:02.799604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ac6c9-8b3e-4ff8-9aa2-daeb1cef2b8b None admin] RBAC: Authorizing `identity:get_project(project_id=f267a58b00ba4a0782e3125f86401b3b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:02.801041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ac6c9-8b3e-4ff8-9aa2-daeb1cef2b8b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:02.802796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 580/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:01:02 2022] GET /identity/v3/projects/f267a58b00ba4a0782e3125f86401b3b => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:02.809683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0256e-cffa-4d6a-be3f-754f7cb115c7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:02.823821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:02.915903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0256e-cffa-4d6a-be3f-754f7cb115c7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:02.950142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe2a25-e422-40f3-a3bd-d97083705176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:02.951365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe2a25-e422-40f3-a3bd-d97083705176 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:02.951638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe2a25-e422-40f3-a3bd-d97083705176 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:02.951904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe2a25-e422-40f3-a3bd-d97083705176 None admin] PATH_INFO: `/v3/projects/f267a58b00ba4a0782e3125f86401b3b/users/1a1b8c547e08431fac65130848ac84c2/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:02.954130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe2a25-e422-40f3-a3bd-d97083705176 None admin] RBAC: Authorizing `identity:create_grant(project_id=f267a58b00ba4a0782e3125f86401b3b, user_id=1a1b8c547e08431fac65130848ac84c2, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:02.955591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe2a25-e422-40f3-a3bd-d97083705176 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:02.973323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 573/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:01:02 2022] PUT /identity/v3/projects/f267a58b00ba4a0782e3125f86401b3b/users/1a1b8c547e08431fac65130848ac84c2/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:01:04.974952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d73c5-d1cf-4b37-a7a6-357efab94258 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:04.975497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d73c5-d1cf-4b37-a7a6-357efab94258 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:04.975497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d73c5-d1cf-4b37-a7a6-357efab94258 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:04.976772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 581/1154] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:04.985713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8fd90-58ce-468b-a1d4-d183f3024331 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:04.986376 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8fd90-58ce-468b-a1d4-d183f3024331 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:04.986639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8fd90-58ce-468b-a1d4-d183f3024331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:05.010885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-45b8fd90-58ce-468b-a1d4-d183f3024331 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:05.012081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-45b8fd90-58ce-468b-a1d4-d183f3024331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:05.079232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:05.085603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 574/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:05.109676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d73c5-d1cf-4b37-a7a6-357efab94258 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:05.230066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d73c5-d1cf-4b37-a7a6-357efab94258 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:05.268314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e66f2-3be5-4bc8-9d1d-07790f507462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:05.269499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e66f2-3be5-4bc8-9d1d-07790f507462 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:05.269983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e66f2-3be5-4bc8-9d1d-07790f507462 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:05.270400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e66f2-3be5-4bc8-9d1d-07790f507462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:05.286493 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e66f2-3be5-4bc8-9d1d-07790f507462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-709e66f2-3be5-4bc8-9d1d-07790f507462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:01:05.293994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:01:05.295057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:01:05.296070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 582/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:01:05.307038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8fd90-58ce-468b-a1d4-d183f3024331 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:05.409956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8fd90-58ce-468b-a1d4-d183f3024331 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:05.449513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:05.450341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:05.450652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:05.451331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:05.452185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:05.452489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:05.454079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:05.462486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 575/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:05.468805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e66f2-3be5-4bc8-9d1d-07790f507462 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:05.500016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:05.570194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e66f2-3be5-4bc8-9d1d-07790f507462 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:05.608025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3a742-1d25-45c6-8f70-bba024404d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:05.608895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3a742-1d25-45c6-8f70-bba024404d26 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:05.609174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3a742-1d25-45c6-8f70-bba024404d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:05.609448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3a742-1d25-45c6-8f70-bba024404d26 None admin] PATH_INFO: `/v3/users/1a1b8c547e08431fac65130848ac84c2` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:05.610783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3a742-1d25-45c6-8f70-bba024404d26 None admin] RBAC: Authorizing `identity:get_user(user_id=1a1b8c547e08431fac65130848ac84c2)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:05.612585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3a742-1d25-45c6-8f70-bba024404d26 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:05.614264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 583/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:01:05 2022] GET /identity/v3/users/1a1b8c547e08431fac65130848ac84c2 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:05.620322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:05.686061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:05.735981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb9200-947d-4d43-b3a5-0f452bc22987 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:05.775615 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180980-119f-46db-86b1-c40096060485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:05.776195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180980-119f-46db-86b1-c40096060485 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:05.776473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180980-119f-46db-86b1-c40096060485 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:05.776745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc180980-119f-46db-86b1-c40096060485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:05.859950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc180980-119f-46db-86b1-c40096060485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:05.861924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc180980-119f-46db-86b1-c40096060485 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:05.921270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:05.966556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 576/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:01:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:01:05.973328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3a742-1d25-45c6-8f70-bba024404d26 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:06.076709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:06.080986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3a742-1d25-45c6-8f70-bba024404d26 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:06.117830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299a86d-dacc-4c6c-af97-42aad4b3065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:06.118718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a86d-dacc-4c6c-af97-42aad4b3065d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:06.118998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a86d-dacc-4c6c-af97-42aad4b3065d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:06.119272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a86d-dacc-4c6c-af97-42aad4b3065d None admin] PATH_INFO: `/v3/projects/f267a58b00ba4a0782e3125f86401b3b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:06.120584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299a86d-dacc-4c6c-af97-42aad4b3065d None admin] RBAC: Authorizing `identity:get_project(project_id=f267a58b00ba4a0782e3125f86401b3b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:06.122051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299a86d-dacc-4c6c-af97-42aad4b3065d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:06.123750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 584/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:01:05 2022] GET /identity/v3/projects/f267a58b00ba4a0782e3125f86401b3b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:06.133565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180980-119f-46db-86b1-c40096060485 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:06.238534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc180980-119f-46db-86b1-c40096060485 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:06.275846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7492f8-e946-48de-a429-bffd52fd63b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:06.276486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7492f8-e946-48de-a429-bffd52fd63b1 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:06.276766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7492f8-e946-48de-a429-bffd52fd63b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:06.277039 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7492f8-e946-48de-a429-bffd52fd63b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:06.277897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7492f8-e946-48de-a429-bffd52fd63b1 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=f267a58b00ba4a0782e3125f86401b3b, user.id=1a1b8c547e08431fac65130848ac84c2) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:06.278203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7492f8-e946-48de-a429-bffd52fd63b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:06.279640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7492f8-e946-48de-a429-bffd52fd63b1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:06.285639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 577/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:01:06 2022] GET /identity/v3/role_assignments?user.id=1a1b8c547e08431fac65130848ac84c2&scope.project.id=f267a58b00ba4a0782e3125f86401b3b&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:08.365756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c5748-377b-425a-a384-399a56f04337 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:08.366688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c5748-377b-425a-a384-399a56f04337 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:08.366688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c5748-377b-425a-a384-399a56f04337 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:08.368887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 585/1162] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:08.375388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3da2-e95a-46c4-a37b-ec0d62609123 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:08.376108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3da2-e95a-46c4-a37b-ec0d62609123 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:08.376298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b3da2-e95a-46c4-a37b-ec0d62609123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:08.400704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a18b3da2-e95a-46c4-a37b-ec0d62609123 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:08.401946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a18b3da2-e95a-46c4-a37b-ec0d62609123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:08.422058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:08.475765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 578/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:08.499095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c5748-377b-425a-a384-399a56f04337 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:08.614310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c5748-377b-425a-a384-399a56f04337 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:08.649613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad108-fe0e-4000-aa4e-ff07cffe8529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:08.650203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad108-fe0e-4000-aa4e-ff07cffe8529 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:08.650482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad108-fe0e-4000-aa4e-ff07cffe8529 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:08.650755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad108-fe0e-4000-aa4e-ff07cffe8529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:08.686338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:08.724282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ad108-fe0e-4000-aa4e-ff07cffe8529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:08.725732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ad108-fe0e-4000-aa4e-ff07cffe8529 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:08.841127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 586/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:01:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:01:08.848203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b3da2-e95a-46c4-a37b-ec0d62609123 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:08.960204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b3da2-e95a-46c4-a37b-ec0d62609123 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:08.996044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571576d-e715-4b98-8759-d3b7f512fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:08.996840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571576d-e715-4b98-8759-d3b7f512fba7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:08.997079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571576d-e715-4b98-8759-d3b7f512fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:08.997378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571576d-e715-4b98-8759-d3b7f512fba7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:09.005019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571576d-e715-4b98-8759-d3b7f512fba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:09.006505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571576d-e715-4b98-8759-d3b7f512fba7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-e571576d-e715-4b98-8759-d3b7f512fba7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:01:09.021163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:01:09.022351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:01:09.023226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 579/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:01:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:01:09.030922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad108-fe0e-4000-aa4e-ff07cffe8529 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:09.103126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:09.138600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad108-fe0e-4000-aa4e-ff07cffe8529 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:09.176649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbf16d-92e5-442d-aaea-2e4bc2f4be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:09.177300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbf16d-92e5-442d-aaea-2e4bc2f4be15 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:09.177580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbf16d-92e5-442d-aaea-2e4bc2f4be15 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:09.177891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbf16d-92e5-442d-aaea-2e4bc2f4be15 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:09.178627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbf16d-92e5-442d-aaea-2e4bc2f4be15 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:09.178934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbf16d-92e5-442d-aaea-2e4bc2f4be15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:09.180292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbf16d-92e5-442d-aaea-2e4bc2f4be15 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:09.187596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 587/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jun 23 17:01:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:11.196991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678a7d-135c-4903-b0b1-94f4be16c889 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:11.197985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678a7d-135c-4903-b0b1-94f4be16c889 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:11.197985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678a7d-135c-4903-b0b1-94f4be16c889 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:11.200139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 580/1167] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:11.206936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d83aa-7045-4a8e-9514-31edb92fec72 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:11.207388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d83aa-7045-4a8e-9514-31edb92fec72 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:11.207512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d83aa-7045-4a8e-9514-31edb92fec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:11.229930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8c0d83aa-7045-4a8e-9514-31edb92fec72 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:11.231130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8c0d83aa-7045-4a8e-9514-31edb92fec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:11.306912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 588/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:11.331068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3678a7d-135c-4903-b0b1-94f4be16c889 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:11.359219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:11.458250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3678a7d-135c-4903-b0b1-94f4be16c889 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:11.494562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86121404-b4fd-40ff-9184-91926dce5bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:11.495519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86121404-b4fd-40ff-9184-91926dce5bf9 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:11.495901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86121404-b4fd-40ff-9184-91926dce5bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:11.496253 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86121404-b4fd-40ff-9184-91926dce5bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:11.497391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86121404-b4fd-40ff-9184-91926dce5bf9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:11.499857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86121404-b4fd-40ff-9184-91926dce5bf9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:11.521122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 581/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Thu Jun 23 17:01:11 2022] POST /identity/v3/domains => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:01:13.557725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5c98-bd7d-4c79-8152-1fbca47b0e81 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:13.558651 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5c98-bd7d-4c79-8152-1fbca47b0e81 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:13.559070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5c98-bd7d-4c79-8152-1fbca47b0e81 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:13.562515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 589/1170] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:13.568094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d242-af26-4228-b7a4-2a5148836824 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:13.568520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d242-af26-4228-b7a4-2a5148836824 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:13.568627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d242-af26-4228-b7a4-2a5148836824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:13.587132 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-bf62d242-af26-4228-b7a4-2a5148836824 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:13.588339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bf62d242-af26-4228-b7a4-2a5148836824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:13.662783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 582/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:13.687489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5c98-bd7d-4c79-8152-1fbca47b0e81 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:13.757756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:13.806602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5c98-bd7d-4c79-8152-1fbca47b0e81 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:13.853964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93fa1-a182-4618-abd0-4dd894c72ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:13.854765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93fa1-a182-4618-abd0-4dd894c72ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:13.855045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93fa1-a182-4618-abd0-4dd894c72ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:13.855318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93fa1-a182-4618-abd0-4dd894c72ec8 None admin] PATH_INFO: `/v3/domains/081753da342d4da89df745efd7e576ed` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:13.866334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe93fa1-a182-4618-abd0-4dd894c72ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=081753da342d4da89df745efd7e576ed)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:13.867772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe93fa1-a182-4618-abd0-4dd894c72ec8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:13.869408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 590/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Jun 23 17:01:13 2022] GET /identity/v3/domains/081753da342d4da89df745efd7e576ed => generated 267 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:13.875566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62d242-af26-4228-b7a4-2a5148836824 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:13.878832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:13.976350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62d242-af26-4228-b7a4-2a5148836824 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:14.011081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d3c35-0ec0-448c-9ccd-4b2790670660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:14.011726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3c35-0ec0-448c-9ccd-4b2790670660 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:14.012005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3c35-0ec0-448c-9ccd-4b2790670660 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:14.012279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3c35-0ec0-448c-9ccd-4b2790670660 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:14.012978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d3c35-0ec0-448c-9ccd-4b2790670660 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:14.014446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d3c35-0ec0-448c-9ccd-4b2790670660 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:14.042803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 583/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:01:13 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:01:16.078983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c5130-e16e-4283-9f58-66c2a55e9b21 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:16.080007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c5130-e16e-4283-9f58-66c2a55e9b21 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:16.080007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c5130-e16e-4283-9f58-66c2a55e9b21 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:16.082233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 591/1174] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:16.091050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4c7a-2f55-45ef-9d04-fddc9b412831 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:16.091784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4c7a-2f55-45ef-9d04-fddc9b412831 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:16.091948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4c7a-2f55-45ef-9d04-fddc9b412831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:16.117405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-339e4c7a-2f55-45ef-9d04-fddc9b412831 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:16.118644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-339e4c7a-2f55-45ef-9d04-fddc9b412831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:16.171934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:16.191312 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 584/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:16.217040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c5130-e16e-4283-9f58-66c2a55e9b21 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:16.330225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c5130-e16e-4283-9f58-66c2a55e9b21 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:16.350386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:16.366194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0804b-3d13-4905-adfe-38ad651e3b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:16.367059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0804b-3d13-4905-adfe-38ad651e3b53 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:16.367337 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0804b-3d13-4905-adfe-38ad651e3b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:16.367606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0804b-3d13-4905-adfe-38ad651e3b53 None admin] PATH_INFO: `/v3/domains/081753da342d4da89df745efd7e576ed` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:16.368819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0804b-3d13-4905-adfe-38ad651e3b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=081753da342d4da89df745efd7e576ed)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:16.370341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0804b-3d13-4905-adfe-38ad651e3b53 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:16.371971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 592/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Jun 23 17:01:16 2022] GET /identity/v3/domains/081753da342d4da89df745efd7e576ed => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:16.380467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4c7a-2f55-45ef-9d04-fddc9b412831 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:16.485307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4c7a-2f55-45ef-9d04-fddc9b412831 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:16.524136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c938b7-5a40-4842-b711-6be53b6bde67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:16.524807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c938b7-5a40-4842-b711-6be53b6bde67 None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:16.525085 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c938b7-5a40-4842-b711-6be53b6bde67 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:16.525359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c938b7-5a40-4842-b711-6be53b6bde67 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:16.526095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c938b7-5a40-4842-b711-6be53b6bde67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:16.527534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c938b7-5a40-4842-b711-6be53b6bde67 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:16.556409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 585/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 17:01:16 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:01:18.632777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0e6b-0211-4215-ba82-a6613aa422b2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:18.633710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0e6b-0211-4215-ba82-a6613aa422b2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:18.633710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0e6b-0211-4215-ba82-a6613aa422b2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:18.635834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 593/1178] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:18.641462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a331b2-7aa1-493a-907a-970f436ba764 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:18.642067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a331b2-7aa1-493a-907a-970f436ba764 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:18.642067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a331b2-7aa1-493a-907a-970f436ba764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:18.661563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-25a331b2-7aa1-493a-907a-970f436ba764 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:18.662848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-25a331b2-7aa1-493a-907a-970f436ba764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:18.700848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:18.734923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 586/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:18.758910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0e6b-0211-4215-ba82-a6613aa422b2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:18.869661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0e6b-0211-4215-ba82-a6613aa422b2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:18.903985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f81c27-2bdc-48b6-9686-4397b10e4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:18.904697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81c27-2bdc-48b6-9686-4397b10e4228 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:18.904979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81c27-2bdc-48b6-9686-4397b10e4228 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:18.905253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f81c27-2bdc-48b6-9686-4397b10e4228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:18.915844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f81c27-2bdc-48b6-9686-4397b10e4228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-09f81c27-2bdc-48b6-9686-4397b10e4228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:01:18.923527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:01:18.924647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:01:18.925955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 594/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:01:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:01:18.930763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a331b2-7aa1-493a-907a-970f436ba764 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:19.032960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a331b2-7aa1-493a-907a-970f436ba764 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:19.068187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:19.068841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:19.069117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:19.069389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:19.070166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:19.070472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:19.071897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:19.080449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 587/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:01:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:19.086456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f81c27-2bdc-48b6-9686-4397b10e4228 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:19.139132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:19.190794 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f81c27-2bdc-48b6-9686-4397b10e4228 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:19.227581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851048f-40d9-44b0-9242-87064054593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:19.228446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851048f-40d9-44b0-9242-87064054593c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:19.228721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851048f-40d9-44b0-9242-87064054593c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:19.228997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851048f-40d9-44b0-9242-87064054593c None admin] PATH_INFO: `/v3/users/525b991c5dbe4e8aac2479bf512cba4a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:19.242323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851048f-40d9-44b0-9242-87064054593c None admin] RBAC: Authorizing `identity:get_user(user_id=525b991c5dbe4e8aac2479bf512cba4a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:19.243774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851048f-40d9-44b0-9242-87064054593c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:19.245390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 595/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:01:19 2022] GET /identity/v3/users/525b991c5dbe4e8aac2479bf512cba4a => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:19.254236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:19.301435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:19.373823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc39b4-1ce1-45e0-ae6c-e892998ca4b8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:19.409425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fda6e-0217-4c96-8472-fafe8e129dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:19.410091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fda6e-0217-4c96-8472-fafe8e129dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:19.410380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fda6e-0217-4c96-8472-fafe8e129dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:19.410646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fda6e-0217-4c96-8472-fafe8e129dc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:19.486488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fda6e-0217-4c96-8472-fafe8e129dc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:19.487872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fda6e-0217-4c96-8472-fafe8e129dc9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:19.523204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:19.589946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 588/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:01:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:01:19.600112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851048f-40d9-44b0-9242-87064054593c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:19.715905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851048f-40d9-44b0-9242-87064054593c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:19.724255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:19.753981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d739d8-1280-425a-af85-3a8a35cf6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:19.754771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d739d8-1280-425a-af85-3a8a35cf6579 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:19.755048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d739d8-1280-425a-af85-3a8a35cf6579 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:19.755318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d739d8-1280-425a-af85-3a8a35cf6579 None admin] PATH_INFO: `/v3/projects/2689d77e1a08448dba062e8d027f9f14` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:19.756551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d739d8-1280-425a-af85-3a8a35cf6579 None admin] RBAC: Authorizing `identity:get_project(project_id=2689d77e1a08448dba062e8d027f9f14)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:19.758017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d739d8-1280-425a-af85-3a8a35cf6579 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:19.759718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 596/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:01:19 2022] GET /identity/v3/projects/2689d77e1a08448dba062e8d027f9f14 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:19.766246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fda6e-0217-4c96-8472-fafe8e129dc9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:19.890808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fda6e-0217-4c96-8472-fafe8e129dc9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:19.930142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01af55-0642-4abe-9cbb-3208be5db5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:19.930799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01af55-0642-4abe-9cbb-3208be5db5ae None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:19.931082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01af55-0642-4abe-9cbb-3208be5db5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:19.931352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01af55-0642-4abe-9cbb-3208be5db5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:19.932190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01af55-0642-4abe-9cbb-3208be5db5ae None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=2689d77e1a08448dba062e8d027f9f14, user.id=525b991c5dbe4e8aac2479bf512cba4a) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:19.932503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01af55-0642-4abe-9cbb-3208be5db5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:19.933975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01af55-0642-4abe-9cbb-3208be5db5ae None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:19.935848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:19.940505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 589/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:01:19 2022] GET /identity/v3/role_assignments?user.id=525b991c5dbe4e8aac2479bf512cba4a&scope.project.id=2689d77e1a08448dba062e8d027f9f14&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:21.916405 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fee2b-9a4d-4afb-9e35-3bf712767447 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:21.917296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fee2b-9a4d-4afb-9e35-3bf712767447 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:21.917296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fee2b-9a4d-4afb-9e35-3bf712767447 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:21.919559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 597/1186] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:21.925783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6343-cab9-468b-8676-b4e2b6e026af None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:21.926239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6343-cab9-468b-8676-b4e2b6e026af None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:21.926373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b6343-cab9-468b-8676-b4e2b6e026af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:21.953712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-410b6343-cab9-468b-8676-b4e2b6e026af None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:21.955149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-410b6343-cab9-468b-8676-b4e2b6e026af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:22.025158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 590/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:22.057365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fee2b-9a4d-4afb-9e35-3bf712767447 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:22.174138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fee2b-9a4d-4afb-9e35-3bf712767447 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:22.208966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f9143-ce8c-4e81-98ef-99863dbd88f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:22.209695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f9143-ce8c-4e81-98ef-99863dbd88f0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:22.210007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f9143-ce8c-4e81-98ef-99863dbd88f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:22.210281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f9143-ce8c-4e81-98ef-99863dbd88f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:22.220801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f9143-ce8c-4e81-98ef-99863dbd88f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-496f9143-ce8c-4e81-98ef-99863dbd88f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:01:22.228385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:01:22.229437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:01:22.230484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 598/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:01:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:01:22.236547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b6343-cab9-468b-8676-b4e2b6e026af None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:22.344823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b6343-cab9-468b-8676-b4e2b6e026af None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:22.371492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:22.381292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:22.382003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:22.382289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:22.382563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:22.383319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:22.383623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:22.385010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:22.394266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 591/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:01:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:22.400418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f9143-ce8c-4e81-98ef-99863dbd88f0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:22.443540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:22.512197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f9143-ce8c-4e81-98ef-99863dbd88f0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:22.546435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c19e-ec9c-4b6e-9a8f-6ad2c53e2c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:22.547298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c19e-ec9c-4b6e-9a8f-6ad2c53e2c17 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:22.547577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c19e-ec9c-4b6e-9a8f-6ad2c53e2c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:22.547951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c19e-ec9c-4b6e-9a8f-6ad2c53e2c17 None admin] PATH_INFO: `/v3/users/525b991c5dbe4e8aac2479bf512cba4a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:22.549121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320c19e-ec9c-4b6e-9a8f-6ad2c53e2c17 None admin] RBAC: Authorizing `identity:get_user(user_id=525b991c5dbe4e8aac2479bf512cba4a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:22.550581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320c19e-ec9c-4b6e-9a8f-6ad2c53e2c17 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:22.552203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 599/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:01:22 2022] GET /identity/v3/users/525b991c5dbe4e8aac2479bf512cba4a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:22.559073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:22.664390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30fb15-d7b3-4e45-8a86-5173b19508eb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:22.706423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57732f6-866d-41ed-95bd-52ddbce78ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:22.707310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57732f6-866d-41ed-95bd-52ddbce78ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:22.707595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57732f6-866d-41ed-95bd-52ddbce78ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:22.707871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57732f6-866d-41ed-95bd-52ddbce78ee9 None admin] PATH_INFO: `/v3/projects/2689d77e1a08448dba062e8d027f9f14` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:22.709105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57732f6-866d-41ed-95bd-52ddbce78ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=2689d77e1a08448dba062e8d027f9f14)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:22.710588 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57732f6-866d-41ed-95bd-52ddbce78ee9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:22.712297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 592/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:01:22 2022] GET /identity/v3/projects/2689d77e1a08448dba062e8d027f9f14 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:22.718508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c19e-ec9c-4b6e-9a8f-6ad2c53e2c17 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:22.836524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c19e-ec9c-4b6e-9a8f-6ad2c53e2c17 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:22.838238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:22.874489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c59c-40d3-4dc2-8190-6410a10efe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:22.875356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c59c-40d3-4dc2-8190-6410a10efe15 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:22.875632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c59c-40d3-4dc2-8190-6410a10efe15 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:22.875897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c59c-40d3-4dc2-8190-6410a10efe15 None admin] PATH_INFO: `/v3/projects/2689d77e1a08448dba062e8d027f9f14/users/525b991c5dbe4e8aac2479bf512cba4a/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:22.877985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c59c-40d3-4dc2-8190-6410a10efe15 None admin] RBAC: Authorizing `identity:create_grant(project_id=2689d77e1a08448dba062e8d027f9f14, user_id=525b991c5dbe4e8aac2479bf512cba4a, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:22.879463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c59c-40d3-4dc2-8190-6410a10efe15 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:22.896065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 600/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:01:22 2022] PUT /identity/v3/projects/2689d77e1a08448dba062e8d027f9f14/users/525b991c5dbe4e8aac2479bf512cba4a/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:01:24.892466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526bdc-eb37-4391-9329-93a21f43a85e None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:24.893082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526bdc-eb37-4391-9329-93a21f43a85e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:24.893082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526bdc-eb37-4391-9329-93a21f43a85e None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:24.894519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 593/1193] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:01:24.900796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807590d-e7fd-4585-8282-c4810cf1c010 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:24.901508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807590d-e7fd-4585-8282-c4810cf1c010 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:24.901718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807590d-e7fd-4585-8282-c4810cf1c010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:24.928484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4807590d-e7fd-4585-8282-c4810cf1c010 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:01:24.929675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4807590d-e7fd-4585-8282-c4810cf1c010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:01:24.998983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 601/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:01:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:01:25.030071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526bdc-eb37-4391-9329-93a21f43a85e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:25.093309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:25.140377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526bdc-eb37-4391-9329-93a21f43a85e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:25.175567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294375d-5880-4b06-9f33-8d742d8e33e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:25.176351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294375d-5880-4b06-9f33-8d742d8e33e9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:25.176627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294375d-5880-4b06-9f33-8d742d8e33e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:25.176896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294375d-5880-4b06-9f33-8d742d8e33e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:25.187568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294375d-5880-4b06-9f33-8d742d8e33e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-5294375d-5880-4b06-9f33-8d742d8e33e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:01:25.195284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:01:25.196473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:01:25.197708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 594/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:01:25.205165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807590d-e7fd-4585-8282-c4810cf1c010 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:25.307579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:25.318181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807590d-e7fd-4585-8282-c4810cf1c010 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:25.354027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:25.354684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:25.354967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:25.355244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:25.355987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:25.356295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:25.357666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:25.366401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 602/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:25.373091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294375d-5880-4b06-9f33-8d742d8e33e9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:25.498953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294375d-5880-4b06-9f33-8d742d8e33e9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:25.518555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:25.545295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e11ea-5621-4651-9d4b-8c23be3390a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:25.546591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e11ea-5621-4651-9d4b-8c23be3390a7 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:25.546879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e11ea-5621-4651-9d4b-8c23be3390a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:25.547151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e11ea-5621-4651-9d4b-8c23be3390a7 None admin] PATH_INFO: `/v3/users/525b991c5dbe4e8aac2479bf512cba4a` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:25.548986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e11ea-5621-4651-9d4b-8c23be3390a7 None admin] RBAC: Authorizing `identity:get_user(user_id=525b991c5dbe4e8aac2479bf512cba4a)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:25.550966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e11ea-5621-4651-9d4b-8c23be3390a7 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:25.552608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 595/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jun 23 17:01:25 2022] GET /identity/v3/users/525b991c5dbe4e8aac2479bf512cba4a => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:25.558623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:25.671338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce984e9-019b-4625-96e2-24bb62daa0a4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:25.713762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba73e8-f2f5-4588-a547-c2c3a52591d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:25.714440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba73e8-f2f5-4588-a547-c2c3a52591d8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:25.714717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba73e8-f2f5-4588-a547-c2c3a52591d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:25.714987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba73e8-f2f5-4588-a547-c2c3a52591d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:25.739219 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:25.790851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba73e8-f2f5-4588-a547-c2c3a52591d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:25.792299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba73e8-f2f5-4588-a547-c2c3a52591d8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:25.892256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 603/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:01:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:01:25.898972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e11ea-5621-4651-9d4b-8c23be3390a7 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:26.001901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e11ea-5621-4651-9d4b-8c23be3390a7 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:26.036797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd766fde-bd09-433b-aebc-a080f9784857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:26.037654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766fde-bd09-433b-aebc-a080f9784857 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:26.037966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766fde-bd09-433b-aebc-a080f9784857 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:26.038230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766fde-bd09-433b-aebc-a080f9784857 None admin] PATH_INFO: `/v3/projects/2689d77e1a08448dba062e8d027f9f14` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:26.039460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd766fde-bd09-433b-aebc-a080f9784857 None admin] RBAC: Authorizing `identity:get_project(project_id=2689d77e1a08448dba062e8d027f9f14)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:26.040914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd766fde-bd09-433b-aebc-a080f9784857 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:26.042648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 596/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jun 23 17:01:25 2022] GET /identity/v3/projects/2689d77e1a08448dba062e8d027f9f14 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:26.049644 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba73e8-f2f5-4588-a547-c2c3a52591d8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:01:26.111658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:26.158301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba73e8-f2f5-4588-a547-c2c3a52591d8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:01:26.193234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd974e0-ca19-4f3c-936d-4a8997e90929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:01:26.193920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd974e0-ca19-4f3c-936d-4a8997e90929 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:01:26.194185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd974e0-ca19-4f3c-936d-4a8997e90929 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:01:26.194454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd974e0-ca19-4f3c-936d-4a8997e90929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:01:26.195277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd974e0-ca19-4f3c-936d-4a8997e90929 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=2689d77e1a08448dba062e8d027f9f14, user.id=525b991c5dbe4e8aac2479bf512cba4a) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:01:26.195579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd974e0-ca19-4f3c-936d-4a8997e90929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:01:26.196998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd974e0-ca19-4f3c-936d-4a8997e90929 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:01:26.203807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 604/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:01:26 2022] GET /identity/v3/role_assignments?user.id=525b991c5dbe4e8aac2479bf512cba4a&scope.project.id=2689d77e1a08448dba062e8d027f9f14&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:01:36.031608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=73 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:01:36.201026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=41 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:21.789113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb90-aaa1-4132-b181-07651ad4c4b5 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:21.789729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb90-aaa1-4132-b181-07651ad4c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:21.789729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb90-aaa1-4132-b181-07651ad4c4b5 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:21.791484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 597/1201] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:02:21.798834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db7f4-30bb-4588-b6d0-e13d61f18168 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:21.798834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db7f4-30bb-4588-b6d0-e13d61f18168 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:21.798834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db7f4-30bb-4588-b6d0-e13d61f18168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:21.815450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bd0db7f4-30bb-4588-b6d0-e13d61f18168 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:21.816599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd0db7f4-30bb-4588-b6d0-e13d61f18168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:21.895119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 605/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:21.918924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebb90-aaa1-4132-b181-07651ad4c4b5 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:22.050332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebb90-aaa1-4132-b181-07651ad4c4b5 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:22.090037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:22.090902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:22.091183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:22.091436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:22.103549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:22.105162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:22.123757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:22.124877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:22.125890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:22.125890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:22.125890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:22.125890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:22.130092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 598/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:22.131337 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db7f4-30bb-4588-b6d0-e13d61f18168 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:22.255176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db7f4-30bb-4588-b6d0-e13d61f18168 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:22.286730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:22.295897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819454-3a4a-4080-9ab8-ad152af41470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:22.296865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819454-3a4a-4080-9ab8-ad152af41470 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:22.297221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819454-3a4a-4080-9ab8-ad152af41470 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:22.297461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819454-3a4a-4080-9ab8-ad152af41470 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:22.298274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819454-3a4a-4080-9ab8-ad152af41470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:22.298590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819454-3a4a-4080-9ab8-ad152af41470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:22.300155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819454-3a4a-4080-9ab8-ad152af41470 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:22.314783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 606/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:22.321441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:22.399036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:22.459499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d966c-9bde-4681-9b2c-72313db00d2b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:22.502210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d6c75-abbd-4071-b1fd-0a0c7c97768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:22.502907 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d6c75-abbd-4071-b1fd-0a0c7c97768e None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:22.503225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d6c75-abbd-4071-b1fd-0a0c7c97768e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:22.503460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d6c75-abbd-4071-b1fd-0a0c7c97768e None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:22.504210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d6c75-abbd-4071-b1fd-0a0c7c97768e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:22.506259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d6c75-abbd-4071-b1fd-0a0c7c97768e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:22.541833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 599/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jun 23 17:02:22 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:02:24.748029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65e0b-8c11-4c24-829c-50b14e3becda None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:24.748648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65e0b-8c11-4c24-829c-50b14e3becda None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:24.748648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb65e0b-8c11-4c24-829c-50b14e3becda None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:24.750093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 607/1206] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:24.756107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2ae2-61cc-450a-a008-c80814bb6b7e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:24.756592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2ae2-61cc-450a-a008-c80814bb6b7e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:24.756681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2ae2-61cc-450a-a008-c80814bb6b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:24.774928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-7cae2ae2-61cc-450a-a008-c80814bb6b7e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:24.776147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-7cae2ae2-61cc-450a-a008-c80814bb6b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:24.857578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 600/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:24.885435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65e0b-8c11-4c24-829c-50b14e3becda None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:25.010367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb65e0b-8c11-4c24-829c-50b14e3becda None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:25.049691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ccb16-4d2b-4cf7-af96-e7ae3a9d2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:25.050625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ccb16-4d2b-4cf7-af96-e7ae3a9d2e32 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:25.050911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ccb16-4d2b-4cf7-af96-e7ae3a9d2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:25.051187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ccb16-4d2b-4cf7-af96-e7ae3a9d2e32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:25.062732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ccb16-4d2b-4cf7-af96-e7ae3a9d2e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-675ccb16-4d2b-4cf7-af96-e7ae3a9d2e32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:02:25.070904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:25.072056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:25.072929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 608/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 17:02:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:25.078857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae2ae2-61cc-450a-a008-c80814bb6b7e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:25.128246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:25.192980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae2ae2-61cc-450a-a008-c80814bb6b7e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:25.232253 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:25.232999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:25.233301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:25.233612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:25.234454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:25.234788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:25.236285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:25.245579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 601/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 17:02:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:25.251234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ccb16-4d2b-4cf7-af96-e7ae3a9d2e32 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:25.308026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:25.365603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ccb16-4d2b-4cf7-af96-e7ae3a9d2e32 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:25.405604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:25.406477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:25.406761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:25.407069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:25.418013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:25.419525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:25.439724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:25.440724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:25.441752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:25.441752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:25.441752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:25.441752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:25.441752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 609/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:02:25.447142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:25.560343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:25.564379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234801ad-4f52-411f-913d-df0add12e5c3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:25.602927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:25.604737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:25.604737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:25.604737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:25.605149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:25.605406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:25.607101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:25.622033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 602/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:25.628484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:25.746089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9022ead-59a2-4995-a17e-5760d6285bbe None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:25.747867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:25.788033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:25.788880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:25.789193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:25.789501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:25.798503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:25.800198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:02:25.818089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:25.819323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:25.820529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:25.821958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 610/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:25.824833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:25.941029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d210dfe-d4a3-434f-a313-e176f4ac1867 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:25.979040 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:25.979958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:25.980344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:25.980726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:25.981606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:25.981956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:25.983460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:26.004231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 603/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 23 17:02:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:26.010425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:26.131698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194f6ed-f244-48a1-b85e-efd5f4669617 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:26.169572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b3c1-6041-4811-870c-a1407fc93105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:26.170490 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b3c1-6041-4811-870c-a1407fc93105 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:26.170834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b3c1-6041-4811-870c-a1407fc93105 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:26.171354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b3c1-6041-4811-870c-a1407fc93105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:26.213925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:26.261885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352b3c1-6041-4811-870c-a1407fc93105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:26.263515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352b3c1-6041-4811-870c-a1407fc93105 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:26.382224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 611/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:02:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:02:26.388805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:26.410767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:26.516022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193100b-220d-4f8d-931e-d5818fd98096 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:26.560463 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:26.561993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:26.561993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:26.562248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:26.575906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:26.577373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:26.598101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:26.599286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:26.605289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:26.605289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:26.605289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:26.605289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:26.605289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 604/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:26.606732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b3c1-6041-4811-870c-a1407fc93105 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:26.680702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:26.727758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b3c1-6041-4811-870c-a1407fc93105 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:26.766103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:26.766844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:26.767133 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:26.767414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:26.768218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:26.768642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:26.770432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:26.789947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 612/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:26.791174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:26.873213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:26.909188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77095-0245-473a-b5d9-891aefe24999 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:26.946757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:26.947506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:26.947788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:26.948065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:26.955783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:26.957619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:02:26.971796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:26.973249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:26.974423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:02:26.974423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:02:26.974423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:02:26.974423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:02:26.974423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:02:26.974423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:02:26.974423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:26.974423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:26.977905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 605/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:02:26.980896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:27.092107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c2a5-cb12-428e-afc1-4eba2c5a2033 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:27.121945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:27.137602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01086f63-21d5-4263-b42f-76fd81ff8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:27.138448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086f63-21d5-4263-b42f-76fd81ff8357 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:27.138787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086f63-21d5-4263-b42f-76fd81ff8357 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:27.139138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086f63-21d5-4263-b42f-76fd81ff8357 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:27.140033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01086f63-21d5-4263-b42f-76fd81ff8357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:27.140343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01086f63-21d5-4263-b42f-76fd81ff8357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:27.141818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01086f63-21d5-4263-b42f-76fd81ff8357 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:27.159196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 613/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:27.165616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:27.277898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229571c6-ee71-4a27-8d10-39ea7779bf12 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:27.307677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:27.313912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f445b-15ce-4e3b-a320-2737c363c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:27.314593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f445b-15ce-4e3b-a320-2737c363c96e None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:27.315634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f445b-15ce-4e3b-a320-2737c363c96e None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:27.315634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f445b-15ce-4e3b-a320-2737c363c96e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:27.316063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f445b-15ce-4e3b-a320-2737c363c96e None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=067f71d863f7472eba2f5e9d04ae350e) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:27.316369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f445b-15ce-4e3b-a320-2737c363c96e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:27.318001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f445b-15ce-4e3b-a320-2737c363c96e None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:27.333822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 606/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:02:27 2022] GET /identity/v3/role_assignments?user.id=067f71d863f7472eba2f5e9d04ae350e&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:29.339884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288c7e-f4be-4f83-be35-3eb01dca4269 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:29.340532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288c7e-f4be-4f83-be35-3eb01dca4269 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:29.340532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa288c7e-f4be-4f83-be35-3eb01dca4269 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:29.342042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 614/1220] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:29.347749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e74a3-2a7e-40c2-8bc6-69ff82204c02 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:29.348201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e74a3-2a7e-40c2-8bc6-69ff82204c02 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:29.348363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e74a3-2a7e-40c2-8bc6-69ff82204c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:29.370382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-412e74a3-2a7e-40c2-8bc6-69ff82204c02 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:29.371605 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-412e74a3-2a7e-40c2-8bc6-69ff82204c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:29.447424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 607/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:29.471153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa288c7e-f4be-4f83-be35-3eb01dca4269 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:29.580627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa288c7e-f4be-4f83-be35-3eb01dca4269 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:29.620012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072866f-1d63-4626-8b61-a06010483fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:29.620849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072866f-1d63-4626-8b61-a06010483fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:29.621133 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072866f-1d63-4626-8b61-a06010483fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:29.621430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072866f-1d63-4626-8b61-a06010483fd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:29.632997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072866f-1d63-4626-8b61-a06010483fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6072866f-1d63-4626-8b61-a06010483fd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:02:29.641243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:29.642439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:29.648655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 615/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 17:02:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:29.649539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e74a3-2a7e-40c2-8bc6-69ff82204c02 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:29.759495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e74a3-2a7e-40c2-8bc6-69ff82204c02 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:29.784240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:29.796388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:29.797073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:29.797354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:29.797628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:29.798513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] RBAC: Adding query filter params (name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:29.798804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:29.800189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:29.808611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 608/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 17:02:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:29.814449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072866f-1d63-4626-8b61-a06010483fd6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:29.862644 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:29.927684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072866f-1d63-4626-8b61-a06010483fd6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:29.963613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:29.964398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:29.964699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:29.964954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:29.976700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:29.979290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:29.996412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:29.997517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:29.998581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:29.998581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:29.998581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:29.998581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:29.998581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 616/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:30.004060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:30.122017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0a48-d3b5-40f4-a7c0-a1a7f6b1a71c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:30.161544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:30.162237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:30.162515 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:30.162786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:30.163501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:30.163804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:30.165177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:30.177082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 609/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:30.183219 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:30.282470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:30.289520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc780-f03c-4ae6-b010-3292443b4f49 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:30.323576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:30.324847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:30.325191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:30.325533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:30.334873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:30.336547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:02:30.353755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:30.360220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:30.361388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 617/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:30.362983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:30.414503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:30.473362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4503f8-f77e-4358-a164-522f779134e8 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:30.518951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:30.519816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:30.520196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:30.520567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:30.521556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:30.521856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:30.523305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:30.541048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 610/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 23 17:02:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:30.549479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:30.657350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ce255-6748-428d-acc8-fba21c4076df None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:30.694788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:30.695698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:30.695962 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:30.696240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:30.710188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:30.711846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:30.730604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:30.731553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:30.732705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:30.732705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:30.732705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:30.732705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:30.732705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 618/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:30.737705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:30.850787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220440fb-d955-4ee9-a95e-49efdc13e6b6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:30.853141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:30.885015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:30.885675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:30.885996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:30.886271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:30.886988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:30.887293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:30.888652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:30.899816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 611/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:30.906081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:30.916865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:31.017359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7e82d-d95a-4799-a38a-01801f55b64a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:31.057264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:31.058104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:31.058386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:31.058737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:31.066448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:31.067980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:02:31.082983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:31.084087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:31.085209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:02:31.085209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:02:31.085209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:02:31.085209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:02:31.085209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:02:31.085209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:02:31.085209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:31.085209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:31.089194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 619/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:31.090442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:31.206006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc5765-ea5e-4dea-be67-527c6c202f3f None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:31.242641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597ba7a-6ee5-440c-a112-5028fa4989b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:31.243420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ba7a-6ee5-440c-a112-5028fa4989b2 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:31.243707 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ba7a-6ee5-440c-a112-5028fa4989b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:31.243984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ba7a-6ee5-440c-a112-5028fa4989b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:31.244773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597ba7a-6ee5-440c-a112-5028fa4989b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:31.245080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597ba7a-6ee5-440c-a112-5028fa4989b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:31.246609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597ba7a-6ee5-440c-a112-5028fa4989b2 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:31.260465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 612/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:31.266884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:31.339484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:31.378235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589b3e6-d07f-4696-845c-e17e469e2a3f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:31.415987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f90a8-7328-4109-83fb-5e1b207e0d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:31.416925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f90a8-7328-4109-83fb-5e1b207e0d3d None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:31.417216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f90a8-7328-4109-83fb-5e1b207e0d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:31.417564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f90a8-7328-4109-83fb-5e1b207e0d3d None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/067f71d863f7472eba2f5e9d04ae350e/roles/e113a817a4414021ba3aab63aadc0c22` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:31.432752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f90a8-7328-4109-83fb-5e1b207e0d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=067f71d863f7472eba2f5e9d04ae350e, role_id=e113a817a4414021ba3aab63aadc0c22)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:31.434260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f90a8-7328-4109-83fb-5e1b207e0d3d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:31.448443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 620/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:02:31 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/067f71d863f7472eba2f5e9d04ae350e/roles/e113a817a4414021ba3aab63aadc0c22 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:02:33.636938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd21d-4d29-453b-9f9a-70db77080f5e None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:33.636938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd21d-4d29-453b-9f9a-70db77080f5e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:33.636938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd21d-4d29-453b-9f9a-70db77080f5e None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:33.636938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 613/1233] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:33.642633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606dad-fd44-447a-afbf-d53b3d40e493 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:33.643035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606dad-fd44-447a-afbf-d53b3d40e493 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:33.643188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606dad-fd44-447a-afbf-d53b3d40e493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:33.660872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e4606dad-fd44-447a-afbf-d53b3d40e493 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:33.662085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e4606dad-fd44-447a-afbf-d53b3d40e493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:33.738982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 621/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:33.768293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bd21d-4d29-453b-9f9a-70db77080f5e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:33.797845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:33.883788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bd21d-4d29-453b-9f9a-70db77080f5e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:33.922178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce898509-30a3-4914-b3c7-3d8eec8319d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:33.922913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898509-30a3-4914-b3c7-3d8eec8319d4 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:33.923196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898509-30a3-4914-b3c7-3d8eec8319d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:33.923462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898509-30a3-4914-b3c7-3d8eec8319d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:33.935019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce898509-30a3-4914-b3c7-3d8eec8319d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-ce898509-30a3-4914-b3c7-3d8eec8319d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:02:33.943736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:33.944904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:33.945884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 614/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jun 23 17:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:33.952053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606dad-fd44-447a-afbf-d53b3d40e493 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:34.001439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:34.058807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606dad-fd44-447a-afbf-d53b3d40e493 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:34.096687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:34.097498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:34.097781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:34.098089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:34.098841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:34.099146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:34.100520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:34.109483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 622/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jun 23 17:02:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:34.115403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce898509-30a3-4914-b3c7-3d8eec8319d4 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:34.205123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:34.221486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce898509-30a3-4914-b3c7-3d8eec8319d4 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:34.262641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:34.263451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:34.263736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:34.264011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:34.277509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:34.279021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:34.296151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:34.297279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:34.298339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:34.298339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:34.298339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:34.298339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:34.298339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 615/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:34.304105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:34.405742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c500a-460f-41ca-b6ca-3ab78e1844fb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:34.416260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:34.441246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:34.441950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:34.442231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:34.442501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:34.443212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:34.443513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:34.444871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:34.456925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 623/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:34.467846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:34.585805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6924a56-7680-4663-b04e-7084b4205076 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:34.620683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:34.621495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:34.621779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:34.622076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:34.624918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:34.630796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:34.632418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:02:34.647697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:34.654315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:34.655493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 616/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:34.656232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:34.768272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6eba9-e1e7-4778-8a79-e8fa013c0529 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:34.811034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:34.811725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:34.812004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:34.812279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:34.813139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:34.813449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:34.814953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:34.834354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 624/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 23 17:02:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:34.840503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:34.964751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07988-6b08-4e44-a3e8-1eff682bf8fc None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:34.999908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc25835-e9e8-47df-ade1-6cd71140486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:35.000566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25835-e9e8-47df-ade1-6cd71140486c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:35.000846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25835-e9e8-47df-ade1-6cd71140486c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:35.001116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25835-e9e8-47df-ade1-6cd71140486c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:35.068027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:35.075418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc25835-e9e8-47df-ade1-6cd71140486c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:35.076879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc25835-e9e8-47df-ade1-6cd71140486c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:35.182391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 617/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:02:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:02:35.188456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:35.218349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:35.300474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb5d1b-5361-4364-98a5-c5feadec007b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:35.338722 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:35.339548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:35.339871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:35.340235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:35.351288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:35.353280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:35.371751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:35.372898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:35.373997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:35.373997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:35.373997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:35.373997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:35.373997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 625/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:35.378798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc25835-e9e8-47df-ade1-6cd71140486c None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:35.481012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:35.488516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc25835-e9e8-47df-ade1-6cd71140486c None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:35.529453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:35.530159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:35.530443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:35.530719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:35.531446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:35.531753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:35.533141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:35.545541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 618/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:35.551921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:35.639659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:35.664348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d156d76-7021-4bbc-824a-38ba8d0119a4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:35.702261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:35.703084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:35.703375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:35.703721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:35.711933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:35.713532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:02:35.728753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:35.729972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:35.731315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 626/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:02:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:02:35.736321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:35.850460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954de4a-bb58-4826-86ba-2421f8a09447 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:35.889108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d3039-218e-431c-82de-27fc24c21445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:35.889882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d3039-218e-431c-82de-27fc24c21445 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:35.890156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d3039-218e-431c-82de-27fc24c21445 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:35.890474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d3039-218e-431c-82de-27fc24c21445 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:35.891286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d3039-218e-431c-82de-27fc24c21445 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:35.891602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d3039-218e-431c-82de-27fc24c21445 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:35.893207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d3039-218e-431c-82de-27fc24c21445 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:35.907529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 619/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:02:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:35.914752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:36.021485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a145c7e-58cf-4a5f-ac7c-eb26180e58de None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:36.059015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccb772-0c50-4caf-be00-3a448bc41074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:36.059702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccb772-0c50-4caf-be00-3a448bc41074 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:36.059984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccb772-0c50-4caf-be00-3a448bc41074 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:36.060261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccb772-0c50-4caf-be00-3a448bc41074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:36.061104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccb772-0c50-4caf-be00-3a448bc41074 None admin] RBAC: Adding query filter params (role.id=e113a817a4414021ba3aab63aadc0c22, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=067f71d863f7472eba2f5e9d04ae350e) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:36.061428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccb772-0c50-4caf-be00-3a448bc41074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:36.062910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccb772-0c50-4caf-be00-3a448bc41074 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:36.069967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 627/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:02:35 2022] GET /identity/v3/role_assignments?user.id=067f71d863f7472eba2f5e9d04ae350e&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=e113a817a4414021ba3aab63aadc0c22 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:38.163891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8486-6952-4cd9-93c3-020935009c8e None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:38.164457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8486-6952-4cd9-93c3-020935009c8e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:38.164457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8486-6952-4cd9-93c3-020935009c8e None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:38.165833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 620/1247] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:02:38.171004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a831-926e-4467-a6c9-a821a8477372 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:38.173097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a831-926e-4467-a6c9-a821a8477372 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:38.173097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5a831-926e-4467-a6c9-a821a8477372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:38.176763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:38.190370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aae5a831-926e-4467-a6c9-a821a8477372 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:38.191793 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aae5a831-926e-4467-a6c9-a821a8477372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:38.275551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 628/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:38.303617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8486-6952-4cd9-93c3-020935009c8e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:38.323583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:38.410879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8486-6952-4cd9-93c3-020935009c8e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:38.445613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db701759-eb5b-43d2-b513-c5d4064fbdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:38.446368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701759-eb5b-43d2-b513-c5d4064fbdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:38.446646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701759-eb5b-43d2-b513-c5d4064fbdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:38.446918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701759-eb5b-43d2-b513-c5d4064fbdf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:38.457815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db701759-eb5b-43d2-b513-c5d4064fbdf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-db701759-eb5b-43d2-b513-c5d4064fbdf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:02:38.465416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:38.466555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:38.467439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 621/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:38.473005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5a831-926e-4467-a6c9-a821a8477372 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:38.577906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5a831-926e-4467-a6c9-a821a8477372 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:38.611871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:38.619637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:38.620776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:38.621063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:38.621340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:38.622296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:38.622607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:38.624481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:38.636965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 629/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:38.645669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db701759-eb5b-43d2-b513-c5d4064fbdf6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:38.728944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:38.758419 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db701759-eb5b-43d2-b513-c5d4064fbdf6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:38.793703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:38.794545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:38.794829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:38.795106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:38.807611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:38.809062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:38.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:38.828462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:38.830038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:38.830038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:38.830038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:38.830038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:38.830038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 622/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:02:38.834146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:38.943957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4b55-2e6e-4651-ab8a-962cb965ceae None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:38.981158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:38.981745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:38.982048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:38.982323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:38.983045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:38.983352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:38.984776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:38.997671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 630/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:39.003958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:39.119547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57d3bc-68bd-404a-b0d7-3142eae3bca9 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:39.149517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:39.157747 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:39.158604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:39.158879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:39.159153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:39.166766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:39.168239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:02:39.183057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:39.184217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:39.185229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 623/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:39.190440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:39.259499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:39.310935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc31e2b-7994-4d58-bd31-e85610c45518 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:39.350267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:39.350955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:39.351240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:39.351515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:39.352773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:39.353125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:39.354865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:39.376098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 631/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 23 17:02:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:39.382207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:39.495232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a961e-decf-40cb-b58d-867b09937cfb None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:39.539109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11025a5c-812b-4670-8f90-efab1c951176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:39.539958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11025a5c-812b-4670-8f90-efab1c951176 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:39.540251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11025a5c-812b-4670-8f90-efab1c951176 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:39.540648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11025a5c-812b-4670-8f90-efab1c951176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:39.605403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:39.620427 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11025a5c-812b-4670-8f90-efab1c951176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:39.622240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11025a5c-812b-4670-8f90-efab1c951176 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:39.743619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 624/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:02:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:02:39.750545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:39.859278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4a2cc-2009-4abc-98d0-7a8f9f5c99b6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:39.873784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:39.901321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:39.902265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:39.902563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:39.902853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:39.916718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:39.918218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:39.938063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:39.939206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:39.940159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:39.940159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:39.940159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:39.940159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:39.940159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 632/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 17:02:39.945717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11025a5c-812b-4670-8f90-efab1c951176 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:40.043755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:40.058811 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11025a5c-812b-4670-8f90-efab1c951176 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:40.102390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:40.103349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:40.103660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:40.104022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:40.104801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:40.105131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:40.106748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:40.120309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 625/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:40.125645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:40.237111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721ccef-5d4f-4389-ab13-3c0e0a4358db None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:40.274920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:40.275733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:40.276085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:40.276359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:40.284316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:40.285936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:02:40.301319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:40.302528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:40.303456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:02:40.303456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:02:40.303456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:02:40.303456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:02:40.303456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:02:40.303456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:02:40.303456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:40.303456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:40.307398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 633/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:40.308554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:40.418194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb67e-616d-420b-93da-435515f3d60b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:40.456106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da7fc8-ec11-421a-915a-ab85b35f16d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:40.456782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da7fc8-ec11-421a-915a-ab85b35f16d5 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:40.457060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da7fc8-ec11-421a-915a-ab85b35f16d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:40.457336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da7fc8-ec11-421a-915a-ab85b35f16d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:40.458144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da7fc8-ec11-421a-915a-ab85b35f16d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:40.458440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da7fc8-ec11-421a-915a-ab85b35f16d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:40.459923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da7fc8-ec11-421a-915a-ab85b35f16d5 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:40.473508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 626/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:02:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:40.479728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:40.512693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:40.601351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ace7a-6db1-40c3-aa10-a7680948d018 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:40.638942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278f4f7-7d8c-460b-93b3-755822bd8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:40.639709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278f4f7-7d8c-460b-93b3-755822bd8479 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:40.640014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278f4f7-7d8c-460b-93b3-755822bd8479 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:40.640289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278f4f7-7d8c-460b-93b3-755822bd8479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:40.641279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278f4f7-7d8c-460b-93b3-755822bd8479 None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=067f71d863f7472eba2f5e9d04ae350e) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:40.641589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278f4f7-7d8c-460b-93b3-755822bd8479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:40.643345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278f4f7-7d8c-460b-93b3-755822bd8479 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:40.649853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 634/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:02:40 2022] GET /identity/v3/role_assignments?user.id=067f71d863f7472eba2f5e9d04ae350e&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:42.730772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bedae7-47cc-4e94-8cab-853506caaf38 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:42.731304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bedae7-47cc-4e94-8cab-853506caaf38 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:42.731304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bedae7-47cc-4e94-8cab-853506caaf38 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:42.732691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 627/1261] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:42.738263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d311-4fb7-4886-8e11-c5fb374539d6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:42.738736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d311-4fb7-4886-8e11-c5fb374539d6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:42.738826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d311-4fb7-4886-8e11-c5fb374539d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:42.756545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f155d311-4fb7-4886-8e11-c5fb374539d6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:42.757731 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f155d311-4fb7-4886-8e11-c5fb374539d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:42.829557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 635/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:42.853111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bedae7-47cc-4e94-8cab-853506caaf38 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:42.868599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:42.970177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bedae7-47cc-4e94-8cab-853506caaf38 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:43.005541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18be57-14ed-44ec-897c-0a334d512ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:43.006353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18be57-14ed-44ec-897c-0a334d512ecf None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:43.006630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18be57-14ed-44ec-897c-0a334d512ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:43.006901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18be57-14ed-44ec-897c-0a334d512ecf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:43.017910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18be57-14ed-44ec-897c-0a334d512ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-8f18be57-14ed-44ec-897c-0a334d512ecf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:02:43.025536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:43.026665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:43.027646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 628/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:02:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:43.033051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155d311-4fb7-4886-8e11-c5fb374539d6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:43.053324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:43.140186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155d311-4fb7-4886-8e11-c5fb374539d6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:43.176212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:43.176865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:43.177146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:43.177421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:43.178203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:43.178506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:43.179872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:43.188212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 636/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:43.194220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18be57-14ed-44ec-897c-0a334d512ecf None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:43.267748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:43.302610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18be57-14ed-44ec-897c-0a334d512ecf None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:43.343974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:43.345166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:43.345589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:43.346039 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:43.357971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:43.359440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:43.376936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:43.378123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:43.379037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:43.379037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:43.379037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:43.379037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:43.379037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 629/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:43.384338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:43.484796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:43.509936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439548-d37b-47c8-84c9-53bdc9e0b198 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:43.546136 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:43.546793 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:43.547072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:43.547344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:43.548063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:43.548366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:43.549833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:43.561663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 637/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:43.570674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:43.689816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713cba-e068-4f3c-8aea-79e53ced5cc6 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:43.716563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:43.732737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:43.733538 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:43.733837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:43.734113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:43.742087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:43.743534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:02:43.757638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:43.758757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:43.759725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 630/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:43.765390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:43.874117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231144-0c8f-4de2-b6a3-b71cb99157d0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:43.909884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:43.910480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:43.910757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:43.911025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:43.911863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:43.912161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:43.913580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:43.922261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:43.931294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 638/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 23 17:02:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:43.940445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:44.045343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e1cee-6ffe-483c-82b8-554a97f75ee3 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:44.080675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:44.081489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:44.081767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:44.082075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:44.092935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:44.094435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:44.112578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:44.113668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:44.114821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:44.114821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:44.114821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:44.114821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:44.114821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 631/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:44.119648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:44.224723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfff3b-2026-4c30-8749-a10ae9ff13a4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:44.261644 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:44.262325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:44.262608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:44.262880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:44.263613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:44.263919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:44.265270 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:44.276639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 639/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:44.285415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:44.326241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:44.398751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ecb87-d065-469c-b2a5-5fb1b9974054 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:44.434952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:44.435732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:44.436007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:44.436279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:44.443981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:44.445440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:02:44.461194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:44.462225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:44.463630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 632/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:44.471149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:44.536336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:44.579962 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be5edb-d1c6-495a-8050-38d9e1c6b64c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:44.615658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea057bb7-2e6c-449c-9829-f7fa3f824720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:44.616312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea057bb7-2e6c-449c-9829-f7fa3f824720 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:44.616590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea057bb7-2e6c-449c-9829-f7fa3f824720 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:44.616860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea057bb7-2e6c-449c-9829-f7fa3f824720 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:44.617653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea057bb7-2e6c-449c-9829-f7fa3f824720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:44.617986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea057bb7-2e6c-449c-9829-f7fa3f824720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:44.619415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea057bb7-2e6c-449c-9829-f7fa3f824720 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:44.631607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 640/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:44.638467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:44.745528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:44.755557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3e90e-0003-4531-89d5-2c239d99e5e0 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:44.795062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c966d3-67a8-40bc-816d-d26290d6baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:44.795880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c966d3-67a8-40bc-816d-d26290d6baa1 None admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:44.796152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c966d3-67a8-40bc-816d-d26290d6baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:44.796417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c966d3-67a8-40bc-816d-d26290d6baa1 None admin] PATH_INFO: `/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/067f71d863f7472eba2f5e9d04ae350e/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:44.798663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c966d3-67a8-40bc-816d-d26290d6baa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ce35d28f42543bea1081516bc0e6e11, user_id=067f71d863f7472eba2f5e9d04ae350e, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:44.800144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c966d3-67a8-40bc-816d-d26290d6baa1 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:44.819010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 633/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jun 23 17:02:44 2022] PUT /identity/v3/projects/2ce35d28f42543bea1081516bc0e6e11/users/067f71d863f7472eba2f5e9d04ae350e/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:02:46.845758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68df5d-b72a-49e3-93d1-340586bac9ba None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:46.846675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68df5d-b72a-49e3-93d1-340586bac9ba None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:46.846675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68df5d-b72a-49e3-93d1-340586bac9ba None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:46.848115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 641/1274] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:46.853767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6765-1e8a-4705-b87f-668d079b9eb2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:46.854245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6765-1e8a-4705-b87f-668d079b9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:46.854338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6765-1e8a-4705-b87f-668d079b9eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:46.871709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b3dc6765-1e8a-4705-b87f-668d079b9eb2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:46.872884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b3dc6765-1e8a-4705-b87f-668d079b9eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:46.955306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 634/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:46.979404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68df5d-b72a-49e3-93d1-340586bac9ba None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:47.101890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68df5d-b72a-49e3-93d1-340586bac9ba None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:47.122002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:47.140458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06540c1d-ca46-44da-b267-ce5ecf4ed493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:47.141253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540c1d-ca46-44da-b267-ce5ecf4ed493 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:47.141540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540c1d-ca46-44da-b267-ce5ecf4ed493 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:47.141839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540c1d-ca46-44da-b267-ce5ecf4ed493 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:47.152647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06540c1d-ca46-44da-b267-ce5ecf4ed493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-06540c1d-ca46-44da-b267-ce5ecf4ed493 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 17:02:47.160466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:47.161579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:47.162935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 642/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jun 23 17:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:47.170621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc6765-1e8a-4705-b87f-668d079b9eb2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:47.260402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:47.283743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc6765-1e8a-4705-b87f-668d079b9eb2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:47.321082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:47.321781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:47.322099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:47.322436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:47.323199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:47.323511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:47.325244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:47.334124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 635/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jun 23 17:02:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:47.343289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06540c1d-ca46-44da-b267-ce5ecf4ed493 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:47.458314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06540c1d-ca46-44da-b267-ce5ecf4ed493 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:47.494829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:47.495872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:47.496148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:47.496417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:47.507468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:47.508921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:47.526538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:47.527559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:47.533303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:47.533303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:47.533303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:47.533303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:47.533303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 643/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:47.533770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:47.644616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2bb6-eb7a-4925-841f-c029fa472b7b None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:47.686334 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:47.687314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:47.687314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:47.687545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:47.688257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:47.688561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:47.689995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:47.702738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 636/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:47.708612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:47.742107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:47.815577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba396bc-6b68-4ed4-ba5e-13a0d23475a9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:47.850300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:47.851092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:47.851374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:47.851650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:47.859355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:47.860796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 17:02:47.875232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:47.876390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:47.878052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 644/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:47.882729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:47.886790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:47.988628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbb883-65e2-4407-9575-96a29d1d047a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:48.023693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:48.024354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:48.024593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:48.024901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:48.025743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:48.026086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:48.027521 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:48.044692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 637/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jun 23 17:02:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:48.052575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:48.151267 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:48.163129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb1605-5711-4242-b5c8-79a1eaa4a682 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:48.198574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50591e5c-bad3-4abe-be92-b2efd9a60b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:48.199570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50591e5c-bad3-4abe-be92-b2efd9a60b6a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:48.199853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50591e5c-bad3-4abe-be92-b2efd9a60b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:48.200131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50591e5c-bad3-4abe-be92-b2efd9a60b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:48.274185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50591e5c-bad3-4abe-be92-b2efd9a60b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:48.275640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50591e5c-bad3-4abe-be92-b2efd9a60b6a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:48.368805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:48.379878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 645/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jun 23 17:02:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 17:02:48.386077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:48.449382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:48.501632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fba2b7-6511-43e2-bf4a-224597d85983 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:48.537551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:48.538381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:48.538659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:48.538934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:48.549332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:48.550850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 17:02:48.568733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:48.569767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:48.570734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 17:02:48.570734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 17:02:48.570734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 17:02:48.570734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:48.570734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 638/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:48.576400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50591e5c-bad3-4abe-be92-b2efd9a60b6a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:48.683356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50591e5c-bad3-4abe-be92-b2efd9a60b6a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:48.719815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:48.720398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:48.720678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:48.720953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:48.721698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:48.722035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:48.723410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:48.735117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 646/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jun 23 17:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:48.741780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:48.861193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a2463-11b5-442a-be6e-27ca15a7136a None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:48.875712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:48.897583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:48.898372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:48.898686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:48.898962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:48.905950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:48.907402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 17:02:48.921314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:48.922400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: ERROR keystone.server.flask.application Jun 23 17:02:48.923330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 639/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jun 23 17:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:48.928844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:48.980846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:49.032366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249fca4-1755-4858-aab9-7d9dce68b658 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:49.068118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e00986-873d-4ce5-bf58-895dc5fb69d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:49.068765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00986-873d-4ce5-bf58-895dc5fb69d6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:49.069046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00986-873d-4ce5-bf58-895dc5fb69d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:49.069318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00986-873d-4ce5-bf58-895dc5fb69d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:49.070142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e00986-873d-4ce5-bf58-895dc5fb69d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:49.070448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e00986-873d-4ce5-bf58-895dc5fb69d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:49.071884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e00986-873d-4ce5-bf58-895dc5fb69d6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:49.085046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 647/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jun 23 17:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:49.091737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:49.198249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277cb1b-c8eb-4f32-8417-01850c4a5762 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:49.233445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eaa83-fd0b-4923-b6a3-203f23f0ee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:49.234035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eaa83-fd0b-4923-b6a3-203f23f0ee2c None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:49.234313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eaa83-fd0b-4923-b6a3-203f23f0ee2c None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:49.234584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eaa83-fd0b-4923-b6a3-203f23f0ee2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:49.235400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eaa83-fd0b-4923-b6a3-203f23f0ee2c None admin] RBAC: Adding query filter params (role.id=a4b74db35b2849f1b9b0ca6454c88831, scope.project.id=2ce35d28f42543bea1081516bc0e6e11, user.id=067f71d863f7472eba2f5e9d04ae350e) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:49.235714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eaa83-fd0b-4923-b6a3-203f23f0ee2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:49.237382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eaa83-fd0b-4923-b6a3-203f23f0ee2c None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:49.243646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 640/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jun 23 17:02:49 2022] GET /identity/v3/role_assignments?user.id=067f71d863f7472eba2f5e9d04ae350e&scope.project.id=2ce35d28f42543bea1081516bc0e6e11&role.id=a4b74db35b2849f1b9b0ca6454c88831 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:51.269091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4fa89-9c56-4f8e-bca9-24479f5a356b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:51.269685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4fa89-9c56-4f8e-bca9-24479f5a356b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:51.269685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4fa89-9c56-4f8e-bca9-24479f5a356b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:51.271039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 648/1288] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:51.277307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49ec95-9d94-44c4-a884-3698817d8506 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:51.278027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49ec95-9d94-44c4-a884-3698817d8506 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:51.278214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49ec95-9d94-44c4-a884-3698817d8506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:51.304019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-ff49ec95-9d94-44c4-a884-3698817d8506 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:51.305206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ff49ec95-9d94-44c4-a884-3698817d8506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:51.337943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:51.381651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 641/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:51.403977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4fa89-9c56-4f8e-bca9-24479f5a356b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:51.523699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4fa89-9c56-4f8e-bca9-24479f5a356b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:51.536275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:51.561546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:51.562395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:51.562680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:51.562955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:51.563612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:51.565065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:51.577773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:51.578884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:51.580001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 649/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:02:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:51.587404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49ec95-9d94-44c4-a884-3698817d8506 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:51.695079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49ec95-9d94-44c4-a884-3698817d8506 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:51.729934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23416581-dd6d-4368-93aa-65d10d1dc748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:51.730591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416581-dd6d-4368-93aa-65d10d1dc748 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:51.730866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416581-dd6d-4368-93aa-65d10d1dc748 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:51.731141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416581-dd6d-4368-93aa-65d10d1dc748 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:51.731844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23416581-dd6d-4368-93aa-65d10d1dc748 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:51.732150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23416581-dd6d-4368-93aa-65d10d1dc748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:51.733526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23416581-dd6d-4368-93aa-65d10d1dc748 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:51.738378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 642/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 23 17:02:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:51.744999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:51.861213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d85732-171e-46ce-8f28-c76dccc29ca8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:51.905874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71895c-5b95-40cc-898c-3dbcf8dafd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:51.906530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71895c-5b95-40cc-898c-3dbcf8dafd87 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:51.906809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71895c-5b95-40cc-898c-3dbcf8dafd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:51.907084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71895c-5b95-40cc-898c-3dbcf8dafd87 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:51.907791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71895c-5b95-40cc-898c-3dbcf8dafd87 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:51.908097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71895c-5b95-40cc-898c-3dbcf8dafd87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:51.909837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71895c-5b95-40cc-898c-3dbcf8dafd87 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:51.914555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 650/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 23 17:02:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:53.907920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2aaf1-7d5d-4dbc-b2df-2095df704923 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:53.908988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2aaf1-7d5d-4dbc-b2df-2095df704923 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:53.908988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2aaf1-7d5d-4dbc-b2df-2095df704923 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:53.911216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 643/1293] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:53.919682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132735-be41-44ca-8f4c-dd8555ac30a8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:53.920369 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132735-be41-44ca-8f4c-dd8555ac30a8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:53.920589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd132735-be41-44ca-8f4c-dd8555ac30a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:53.946299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cd132735-be41-44ca-8f4c-dd8555ac30a8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:53.947410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cd132735-be41-44ca-8f4c-dd8555ac30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:53.982789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:54.020937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 651/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:54.056082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2aaf1-7d5d-4dbc-b2df-2095df704923 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:54.099887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:54.173188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2aaf1-7d5d-4dbc-b2df-2095df704923 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:54.211168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0401a53-9c34-4c33-a286-bc68ecd430fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:54.211744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0401a53-9c34-4c33-a286-bc68ecd430fe None admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:54.212023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0401a53-9c34-4c33-a286-bc68ecd430fe None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:54.212295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0401a53-9c34-4c33-a286-bc68ecd430fe None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:54.213010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0401a53-9c34-4c33-a286-bc68ecd430fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:54.214430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0401a53-9c34-4c33-a286-bc68ecd430fe None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:54.232160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 644/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jun 23 17:02:54 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:02:56.252868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c844-5601-460e-a9f6-eea457cab2e3 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:56.253845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c844-5601-460e-a9f6-eea457cab2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:56.253845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c844-5601-460e-a9f6-eea457cab2e3 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:56.256066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 652/1296] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:56.264874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a81000-fe72-4d1f-87b9-72b223d78ce2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:56.265556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a81000-fe72-4d1f-87b9-72b223d78ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:56.265733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a81000-fe72-4d1f-87b9-72b223d78ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:56.285448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-01a81000-fe72-4d1f-87b9-72b223d78ce2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:56.286673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-01a81000-fe72-4d1f-87b9-72b223d78ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:56.363567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 645/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:56.387160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c844-5601-460e-a9f6-eea457cab2e3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:56.502660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c844-5601-460e-a9f6-eea457cab2e3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:56.546856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:56.548363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:56.548704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:56.549498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:56.550589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:56.553129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:56.571646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:56.572928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:56.574440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 653/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:02:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:56.581113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a81000-fe72-4d1f-87b9-72b223d78ce2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:56.606067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:56.696177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a81000-fe72-4d1f-87b9-72b223d78ce2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:56.743186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:56.743843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:56.744122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:56.744401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:56.745107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:56.745410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:56.746824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:56.752391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 646/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 23 17:02:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:56.761847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:56.804431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:56.885702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3d78f-d4fa-47cf-8d6f-fd23b0f7d8b9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:56.932442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af9f1f-00fe-464e-8de1-3e585ffa248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:56.933101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af9f1f-00fe-464e-8de1-3e585ffa248c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:56.933384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af9f1f-00fe-464e-8de1-3e585ffa248c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:56.933663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af9f1f-00fe-464e-8de1-3e585ffa248c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:56.934499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af9f1f-00fe-464e-8de1-3e585ffa248c None admin] RBAC: Adding query filter params (interface=public, service_id=93f30caac1a049479420fc52d39cf4a8, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:56.934818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af9f1f-00fe-464e-8de1-3e585ffa248c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:56.936214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af9f1f-00fe-464e-8de1-3e585ffa248c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:56.941999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 654/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jun 23 17:02:56 2022] GET /identity/v3/endpoints?service_id=93f30caac1a049479420fc52d39cf4a8&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:02:56.951154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:57.040726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:57.064438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffff6a-223f-40cf-946b-a901dba1da65 None admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:57.100788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad16e8-f44f-4dbc-a3a0-4acfedde5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:57.101440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad16e8-f44f-4dbc-a3a0-4acfedde5c9b None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:57.101727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad16e8-f44f-4dbc-a3a0-4acfedde5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:57.102037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad16e8-f44f-4dbc-a3a0-4acfedde5c9b None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:57.102717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad16e8-f44f-4dbc-a3a0-4acfedde5c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:57.104112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad16e8-f44f-4dbc-a3a0-4acfedde5c9b None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:57.111141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 647/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jun 23 17:02:56 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:02:59.107145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2425dc2-0cf6-40aa-8879-e8f572bc4c86 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:59.108045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2425dc2-0cf6-40aa-8879-e8f572bc4c86 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:59.108045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2425dc2-0cf6-40aa-8879-e8f572bc4c86 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:59.110231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 655/1302] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:02:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:02:59.116558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d4be-3ac9-4abe-bee1-0f2b9acfc412 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:59.117279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d4be-3ac9-4abe-bee1-0f2b9acfc412 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:59.117461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d4be-3ac9-4abe-bee1-0f2b9acfc412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:59.139455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-6f44d4be-3ac9-4abe-bee1-0f2b9acfc412 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:02:59.140668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6f44d4be-3ac9-4abe-bee1-0f2b9acfc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:02:59.215459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 648/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:02:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 17:02:59.247799 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2425dc2-0cf6-40aa-8879-e8f572bc4c86 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:59.357885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:59.365110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2425dc2-0cf6-40aa-8879-e8f572bc4c86 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:59.399435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:59.400225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:59.400503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:59.400771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:59.401424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:59.402813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 17:02:59.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 17:02:59.415950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 23 17:02:59.417156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 656/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jun 23 17:02:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 17:02:59.422235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d4be-3ac9-4abe-bee1-0f2b9acfc412 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:59.514591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:02:59.544754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d4be-3ac9-4abe-bee1-0f2b9acfc412 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:59.582146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c4486-eed5-4282-84d3-7d3019317c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:59.582807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c4486-eed5-4282-84d3-7d3019317c92 None admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:59.583086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c4486-eed5-4282-84d3-7d3019317c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:59.583359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c4486-eed5-4282-84d3-7d3019317c92 None admin] PATH_INFO: `/v3/services` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:59.584097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c4486-eed5-4282-84d3-7d3019317c92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:02:59.584413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c4486-eed5-4282-84d3-7d3019317c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:59.585785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c4486-eed5-4282-84d3-7d3019317c92 None admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:59.591314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 649/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jun 23 17:02:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:02:59.597763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:02:59.703365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e156652-4b47-4de4-b941-03cd175daddb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:02:59.740431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b2356-f588-47b2-bacc-e591f309f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:02:59.741075 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b2356-f588-47b2-bacc-e591f309f7b6 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:02:59.741353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b2356-f588-47b2-bacc-e591f309f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:02:59.741623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b2356-f588-47b2-bacc-e591f309f7b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:02:59.742391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b2356-f588-47b2-bacc-e591f309f7b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:02:59.743763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b2356-f588-47b2-bacc-e591f309f7b6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:02:59.765911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 657/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jun 23 17:02:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:03:09.588148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=30 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:03:09.761346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:03.021733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b0e5-b56e-42d1-ab5d-99d2bab30b3d None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:03.022299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b0e5-b56e-42d1-ab5d-99d2bab30b3d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:03.022299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b0e5-b56e-42d1-ab5d-99d2bab30b3d None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:03.023794 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 650/1307] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:04:03.028896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ace9f1-b524-411a-98f1-ed98b28bb109 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:03.029337 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ace9f1-b524-411a-98f1-ed98b28bb109 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:03.029564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ace9f1-b524-411a-98f1-ed98b28bb109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:03.114828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-65ace9f1-b524-411a-98f1-ed98b28bb109 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:03.116003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-65ace9f1-b524-411a-98f1-ed98b28bb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:03.246325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 658/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:03.283694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a62d2-7628-43fc-a807-0c00ddc254a5 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:03.283956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a62d2-7628-43fc-a807-0c00ddc254a5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:03.284245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a62d2-7628-43fc-a807-0c00ddc254a5 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:03.285643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 651/1309] 10.222.0.18 () {54 vars in 964 bytes} [Thu Jun 23 17:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:03.292604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6530373-d09c-4299-9ed5-d86ba4ff2a58 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:03.293069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6530373-d09c-4299-9ed5-d86ba4ff2a58 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:03.293510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6530373-d09c-4299-9ed5-d86ba4ff2a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:03.379454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e6530373-d09c-4299-9ed5-d86ba4ff2a58 None None] MFA Rules not processed for user `2a92136d53514159a22faacb60ef0c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:03.380683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6530373-d09c-4299-9ed5-d86ba4ff2a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:03.402773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:03.463784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 659/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Jun 23 17:04:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:03.474521 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a62d2-7628-43fc-a807-0c00ddc254a5 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:03.476393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-021a62d2-7628-43fc-a807-0c00ddc254a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:03.587737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a62d2-7628-43fc-a807-0c00ddc254a5 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:03.667831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c151d0b-213b-4ab5-984c-d5576dc9cc47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:03.668491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151d0b-213b-4ab5-984c-d5576dc9cc47 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:03.668772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151d0b-213b-4ab5-984c-d5576dc9cc47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:03.669338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c151d0b-213b-4ab5-984c-d5576dc9cc47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:03.671234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1c151d0b-213b-4ab5-984c-d5576dc9cc47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:03.735217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:03.793616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c151d0b-213b-4ab5-984c-d5576dc9cc47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:03.795111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c151d0b-213b-4ab5-984c-d5576dc9cc47 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:03.814762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 652/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:06.112976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98afde-b1f7-4a01-9980-0575f8df05a4 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:06.113550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98afde-b1f7-4a01-9980-0575f8df05a4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:06.113550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98afde-b1f7-4a01-9980-0575f8df05a4 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:06.114919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 660/1312] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:06.120234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7be2-dfd6-439a-99b7-26daf26a3cc9 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:06.120664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7be2-dfd6-439a-99b7-26daf26a3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:06.120775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7be2-dfd6-439a-99b7-26daf26a3cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:06.194159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-69fe7be2-dfd6-439a-99b7-26daf26a3cc9 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:06.195405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-69fe7be2-dfd6-439a-99b7-26daf26a3cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:06.294696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 653/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:06.347900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7ddfc-b160-4a9f-ab46-5d35527a754b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:06.348284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7ddfc-b160-4a9f-ab46-5d35527a754b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:06.348628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7ddfc-b160-4a9f-ab46-5d35527a754b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:06.350109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 661/1314] 10.222.0.18 () {54 vars in 964 bytes} [Thu Jun 23 17:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:06.356414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af05f-b331-4e66-9879-8c885dcaddbc None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:06.356699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af05f-b331-4e66-9879-8c885dcaddbc None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:06.356975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af05f-b331-4e66-9879-8c885dcaddbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:06.367972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:06.443478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-143af05f-b331-4e66-9879-8c885dcaddbc None None] MFA Rules not processed for user `2a92136d53514159a22faacb60ef0c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:06.444721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-143af05f-b331-4e66-9879-8c885dcaddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:06.527723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 654/1315] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Jun 23 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:06.537198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7ddfc-b160-4a9f-ab46-5d35527a754b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:06.538791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4ec7ddfc-b160-4a9f-ab46-5d35527a754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:06.645732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7ddfc-b160-4a9f-ab46-5d35527a754b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:06.723019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:06.725296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569c0c-fed9-454d-8ad0-0ca73414a2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:06.726027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569c0c-fed9-454d-8ad0-0ca73414a2bd service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:06.726246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569c0c-fed9-454d-8ad0-0ca73414a2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:06.726760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569c0c-fed9-454d-8ad0-0ca73414a2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:06.728804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3d569c0c-fed9-454d-8ad0-0ca73414a2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:06.846350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d569c0c-fed9-454d-8ad0-0ca73414a2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:06.847783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d569c0c-fed9-454d-8ad0-0ca73414a2bd service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:06.866813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 662/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:09.413140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fb20-6ad6-43f0-a0fc-eb8016cf6f7a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:09.413733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fb20-6ad6-43f0-a0fc-eb8016cf6f7a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:09.413733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741fb20-6ad6-43f0-a0fc-eb8016cf6f7a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:09.415155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 655/1317] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:09.420543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc40c7-840e-4bce-bf3c-fa45e0021c91 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:09.420965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc40c7-840e-4bce-bf3c-fa45e0021c91 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:09.421113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc40c7-840e-4bce-bf3c-fa45e0021c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:09.487062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-88fc40c7-840e-4bce-bf3c-fa45e0021c91 None None] MFA Rules not processed for user `f4a7349d4c204fb79a3e615178e43fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:09.488284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-88fc40c7-840e-4bce-bf3c-fa45e0021c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:09.544180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:09.592193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 663/1318] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:09.633024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741fb20-6ad6-43f0-a0fc-eb8016cf6f7a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:09.635591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5741fb20-6ad6-43f0-a0fc-eb8016cf6f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:09.755772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741fb20-6ad6-43f0-a0fc-eb8016cf6f7a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:09.758572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:09.832274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ed031-0ee4-4d9b-b80f-6f43357e8180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:09.832917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed031-0ee4-4d9b-b80f-6f43357e8180 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:09.833260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed031-0ee4-4d9b-b80f-6f43357e8180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:09.833539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed031-0ee4-4d9b-b80f-6f43357e8180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:09.835235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-dc9ed031-0ee4-4d9b-b80f-6f43357e8180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:09.950760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ed031-0ee4-4d9b-b80f-6f43357e8180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:09.952207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ed031-0ee4-4d9b-b80f-6f43357e8180 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:09.973399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 656/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:12.538510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f505d-30dc-4c0b-9e7a-96db45f6b5c5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:12.539082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f505d-30dc-4c0b-9e7a-96db45f6b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:12.539082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f505d-30dc-4c0b-9e7a-96db45f6b5c5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:12.540827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 664/1320] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:12.547400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5841a30-3246-4d98-a5ea-9271fa15a6bb None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:12.547972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5841a30-3246-4d98-a5ea-9271fa15a6bb None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:12.547972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5841a30-3246-4d98-a5ea-9271fa15a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:12.589457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:12.614937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d5841a30-3246-4d98-a5ea-9271fa15a6bb None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:12.616143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d5841a30-3246-4d98-a5ea-9271fa15a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:12.716437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 657/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:04:12.756179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f505d-30dc-4c0b-9e7a-96db45f6b5c5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:12.758580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-af4f505d-30dc-4c0b-9e7a-96db45f6b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:12.873262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f505d-30dc-4c0b-9e7a-96db45f6b5c5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:12.951740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae36318-1624-4d7a-90ca-bbb491130e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:12.952394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae36318-1624-4d7a-90ca-bbb491130e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:12.952677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae36318-1624-4d7a-90ca-bbb491130e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:12.952949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae36318-1624-4d7a-90ca-bbb491130e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:12.954904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fae36318-1624-4d7a-90ca-bbb491130e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:12.962706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:13.081327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae36318-1624-4d7a-90ca-bbb491130e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:13.082717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae36318-1624-4d7a-90ca-bbb491130e32 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:13.102015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 665/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:15.838161 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c16a-6f70-49e6-941f-ea60fc336d2d None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:15.838712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c16a-6f70-49e6-941f-ea60fc336d2d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:15.838829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c16a-6f70-49e6-941f-ea60fc336d2d None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:15.840400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 658/1323] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:15.846239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d42c8-0572-4e5e-b412-1e4b7a8a2af1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:15.846730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d42c8-0572-4e5e-b412-1e4b7a8a2af1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:15.846826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d42c8-0572-4e5e-b412-1e4b7a8a2af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:15.912312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a66d42c8-0572-4e5e-b412-1e4b7a8a2af1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:15.913530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a66d42c8-0572-4e5e-b412-1e4b7a8a2af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:15.977877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:16.022679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 666/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:16.059833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81c16a-6f70-49e6-941f-ea60fc336d2d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:16.061401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0b81c16a-6f70-49e6-941f-ea60fc336d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:16.172988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81c16a-6f70-49e6-941f-ea60fc336d2d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:16.185769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:16.249109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17ea4-6a65-4ee5-9c81-e568ae942aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:16.249668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17ea4-6a65-4ee5-9c81-e568ae942aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:16.249985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17ea4-6a65-4ee5-9c81-e568ae942aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:16.250255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17ea4-6a65-4ee5-9c81-e568ae942aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:16.252088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-75d17ea4-6a65-4ee5-9c81-e568ae942aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:16.366803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17ea4-6a65-4ee5-9c81-e568ae942aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:16.368167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17ea4-6a65-4ee5-9c81-e568ae942aa0 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:16.387629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 659/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:18.451608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7799-5a47-4e11-9a7c-e5171cd9d727 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:18.452145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7799-5a47-4e11-9a7c-e5171cd9d727 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:18.452145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7799-5a47-4e11-9a7c-e5171cd9d727 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:18.453425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 667/1326] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:18.458813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4774d6-34aa-458b-b36d-57ec7696a6ae None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:18.459254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4774d6-34aa-458b-b36d-57ec7696a6ae None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:18.459343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4774d6-34aa-458b-b36d-57ec7696a6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:18.507966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:18.526501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-fe4774d6-34aa-458b-b36d-57ec7696a6ae None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:18.527716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fe4774d6-34aa-458b-b36d-57ec7696a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:18.628282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 660/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:18.664250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7799-5a47-4e11-9a7c-e5171cd9d727 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:18.665844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f3ee7799-5a47-4e11-9a7c-e5171cd9d727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:18.780263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7799-5a47-4e11-9a7c-e5171cd9d727 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:18.864498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2b451-10a4-42df-a92d-247999732328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:18.865157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b451-10a4-42df-a92d-247999732328 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:18.865434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b451-10a4-42df-a92d-247999732328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:18.865710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2b451-10a4-42df-a92d-247999732328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:18.867377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-05b2b451-10a4-42df-a92d-247999732328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:18.884711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:18.986568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2b451-10a4-42df-a92d-247999732328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:18.988413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2b451-10a4-42df-a92d-247999732328 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:19.008082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 668/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:21.112759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52eee1-8ae7-4d98-81b4-78c7b0dad48a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:21.113400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52eee1-8ae7-4d98-81b4-78c7b0dad48a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:21.113400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52eee1-8ae7-4d98-81b4-78c7b0dad48a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:21.114699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 661/1329] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:21.120635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2fb22-a75b-4e3e-92e2-20169eb0130b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:21.121158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2fb22-a75b-4e3e-92e2-20169eb0130b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:21.121264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2fb22-a75b-4e3e-92e2-20169eb0130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:21.190484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e8c2fb22-a75b-4e3e-92e2-20169eb0130b None None] MFA Rules not processed for user `f4a7349d4c204fb79a3e615178e43fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:21.191712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8c2fb22-a75b-4e3e-92e2-20169eb0130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:21.263678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:21.298161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 669/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:21.335910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52eee1-8ae7-4d98-81b4-78c7b0dad48a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:21.337910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ed52eee1-8ae7-4d98-81b4-78c7b0dad48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:21.447812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52eee1-8ae7-4d98-81b4-78c7b0dad48a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:21.468187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:21.522244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c0d4-6423-450e-a2b4-92500d5eb137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:21.522897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c0d4-6423-450e-a2b4-92500d5eb137 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:21.523174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c0d4-6423-450e-a2b4-92500d5eb137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:21.523448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c0d4-6423-450e-a2b4-92500d5eb137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:21.525110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-56d0c0d4-6423-450e-a2b4-92500d5eb137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:21.653171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0c0d4-6423-450e-a2b4-92500d5eb137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:21.654796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0c0d4-6423-450e-a2b4-92500d5eb137 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:21.676096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 662/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:24.109180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72f0be-7a0b-471c-b515-d73f978156ad None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:24.110126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72f0be-7a0b-471c-b515-d73f978156ad None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:24.110126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72f0be-7a0b-471c-b515-d73f978156ad None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:24.111915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 670/1332] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:24.117272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e62c6-0586-496b-a504-20fe2098a0e8 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:24.117720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e62c6-0586-496b-a504-20fe2098a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:24.117841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e62c6-0586-496b-a504-20fe2098a0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:24.185471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:24.190548 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-af6e62c6-0586-496b-a504-20fe2098a0e8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:24.193177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-af6e62c6-0586-496b-a504-20fe2098a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:24.305490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 663/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:24.344778 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72f0be-7a0b-471c-b515-d73f978156ad None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:24.346455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7e72f0be-7a0b-471c-b515-d73f978156ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:24.458113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72f0be-7a0b-471c-b515-d73f978156ad None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:24.532390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9a528-b7ee-4596-8fc6-dc9eddf11f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:24.533036 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a528-b7ee-4596-8fc6-dc9eddf11f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:24.533316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a528-b7ee-4596-8fc6-dc9eddf11f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:24.533584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a528-b7ee-4596-8fc6-dc9eddf11f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:24.535247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7ca9a528-b7ee-4596-8fc6-dc9eddf11f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:24.564158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:24.650436 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9a528-b7ee-4596-8fc6-dc9eddf11f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:24.651868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9a528-b7ee-4596-8fc6-dc9eddf11f68 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:24.669836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 671/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:26.727861 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b487-325c-4189-8403-0db92ba0ee69 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:26.728442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b487-325c-4189-8403-0db92ba0ee69 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:26.728442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78b487-325c-4189-8403-0db92ba0ee69 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:26.729905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 664/1335] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:26.735324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daedd34-e686-428f-8ddc-a67f782e8621 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:26.735762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daedd34-e686-428f-8ddc-a67f782e8621 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:26.735872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daedd34-e686-428f-8ddc-a67f782e8621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:26.806150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1daedd34-e686-428f-8ddc-a67f782e8621 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:26.807627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1daedd34-e686-428f-8ddc-a67f782e8621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:26.888937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:26.912330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 672/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:26.952824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78b487-325c-4189-8403-0db92ba0ee69 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:26.954533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2c78b487-325c-4189-8403-0db92ba0ee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:27.061370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78b487-325c-4189-8403-0db92ba0ee69 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:27.092799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:27.147569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56d5d0-1a19-42ac-902a-2b022975332b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:27.148259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56d5d0-1a19-42ac-902a-2b022975332b service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:27.148547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56d5d0-1a19-42ac-902a-2b022975332b service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:27.148817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56d5d0-1a19-42ac-902a-2b022975332b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:27.150510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2c56d5d0-1a19-42ac-902a-2b022975332b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:27.277786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56d5d0-1a19-42ac-902a-2b022975332b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:27.279266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56d5d0-1a19-42ac-902a-2b022975332b service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:27.297976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 665/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:29.680936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233824-9be9-449d-8b18-9f8397cc9728 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:29.681532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233824-9be9-449d-8b18-9f8397cc9728 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:29.681532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233824-9be9-449d-8b18-9f8397cc9728 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:29.682889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 673/1338] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:29.688730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9747-70d3-4853-a749-7f4eacd5b36c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:29.689160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9747-70d3-4853-a749-7f4eacd5b36c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:29.689329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9747-70d3-4853-a749-7f4eacd5b36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:29.768404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c1fa9747-70d3-4853-a749-7f4eacd5b36c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:29.769621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c1fa9747-70d3-4853-a749-7f4eacd5b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:29.778070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:29.872379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 666/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:29.911601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233824-9be9-449d-8b18-9f8397cc9728 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:29.913145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-46233824-9be9-449d-8b18-9f8397cc9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:30.024783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233824-9be9-449d-8b18-9f8397cc9728 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:30.114838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c062d7-760b-449a-8e2f-ccd4924b6e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:30.115502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c062d7-760b-449a-8e2f-ccd4924b6e97 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:30.115782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c062d7-760b-449a-8e2f-ccd4924b6e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:30.116056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c062d7-760b-449a-8e2f-ccd4924b6e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:30.117731 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b4c062d7-760b-449a-8e2f-ccd4924b6e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:30.157941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:30.235022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c062d7-760b-449a-8e2f-ccd4924b6e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:30.236532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c062d7-760b-449a-8e2f-ccd4924b6e97 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:30.256807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 674/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:04:34.252591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59483f47-a66e-43c2-a340-fd7ba22125af None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:34.253155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59483f47-a66e-43c2-a340-fd7ba22125af None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:34.253155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59483f47-a66e-43c2-a340-fd7ba22125af None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:34.254565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 667/1341] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:34.259916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbc7d-085b-4f9e-8970-776e25005eaf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:34.260381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbc7d-085b-4f9e-8970-776e25005eaf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:34.260486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbc7d-085b-4f9e-8970-776e25005eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:34.334898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-beedbc7d-085b-4f9e-8970-776e25005eaf None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:34.336115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-beedbc7d-085b-4f9e-8970-776e25005eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:34.429332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:34.442961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 675/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:34.482118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59483f47-a66e-43c2-a340-fd7ba22125af None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:34.484456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-59483f47-a66e-43c2-a340-fd7ba22125af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:34.585889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59483f47-a66e-43c2-a340-fd7ba22125af None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:34.590430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17b495-35fb-4ce2-967d-f7b41905e561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:34.591086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b495-35fb-4ce2-967d-f7b41905e561 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:34.591362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b495-35fb-4ce2-967d-f7b41905e561 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:34.591756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b495-35fb-4ce2-967d-f7b41905e561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:34.601651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17b495-35fb-4ce2-967d-f7b41905e561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:34.603137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17b495-35fb-4ce2-967d-f7b41905e561 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:34.612759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 668/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:37.406664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559727e9-2598-434d-a467-c2f3cc2abe00 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:37.407728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559727e9-2598-434d-a467-c2f3cc2abe00 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:37.407728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559727e9-2598-434d-a467-c2f3cc2abe00 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:37.408880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 676/1344] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:37.415091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466860d-3d7e-4d8b-89b8-e4b86c8490e7 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:37.415702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466860d-3d7e-4d8b-89b8-e4b86c8490e7 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:37.415702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466860d-3d7e-4d8b-89b8-e4b86c8490e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:37.446596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b466860d-3d7e-4d8b-89b8-e4b86c8490e7 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:37.447927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b466860d-3d7e-4d8b-89b8-e4b86c8490e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:37.478714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:37.536647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 669/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:37.575147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559727e9-2598-434d-a467-c2f3cc2abe00 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:37.576866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-559727e9-2598-434d-a467-c2f3cc2abe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:37.590323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559727e9-2598-434d-a467-c2f3cc2abe00 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:37.594101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85287c-f566-4218-95e4-c15719ce19a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:37.594948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85287c-f566-4218-95e4-c15719ce19a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:37.595206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85287c-f566-4218-95e4-c15719ce19a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:37.595503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85287c-f566-4218-95e4-c15719ce19a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:37.606016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85287c-f566-4218-95e4-c15719ce19a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:37.607483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85287c-f566-4218-95e4-c15719ce19a2 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:37.618659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 677/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:42.071597 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458964-3174-47b8-9fd7-20c57e69f4e6 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:42.072180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458964-3174-47b8-9fd7-20c57e69f4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:42.072180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458964-3174-47b8-9fd7-20c57e69f4e6 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:42.073550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 670/1347] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:42.078959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d569b-f0e8-434c-aa1f-ac92b78c00cd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:42.079471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d569b-f0e8-434c-aa1f-ac92b78c00cd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:42.079647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d569b-f0e8-434c-aa1f-ac92b78c00cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:42.097702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-083d569b-f0e8-434c-aa1f-ac92b78c00cd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:42.098958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-083d569b-f0e8-434c-aa1f-ac92b78c00cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:42.106997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 678/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:42.145876 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458964-3174-47b8-9fd7-20c57e69f4e6 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:42.158399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458964-3174-47b8-9fd7-20c57e69f4e6 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:42.162205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8e938-d0a1-4f36-bf9a-9c959909d727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:42.162808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8e938-d0a1-4f36-bf9a-9c959909d727 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:42.163088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8e938-d0a1-4f36-bf9a-9c959909d727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:42.163353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8e938-d0a1-4f36-bf9a-9c959909d727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:42.173396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8e938-d0a1-4f36-bf9a-9c959909d727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:42.175493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8e938-d0a1-4f36-bf9a-9c959909d727 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:42.196959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 671/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:47.196389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e83fc-cc4d-4322-a77a-ebd46cc27f03 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:47.197291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e83fc-cc4d-4322-a77a-ebd46cc27f03 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:47.197747 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e83fc-cc4d-4322-a77a-ebd46cc27f03 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:47.199600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 679/1350] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:04:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:47.204896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88ebbb-a72a-4d36-b427-e6be4eb82be9 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:47.205747 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88ebbb-a72a-4d36-b427-e6be4eb82be9 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:47.206272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88ebbb-a72a-4d36-b427-e6be4eb82be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:47.274693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-eb88ebbb-a72a-4d36-b427-e6be4eb82be9 None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:47.276232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-eb88ebbb-a72a-4d36-b427-e6be4eb82be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:47.353948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 672/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:51.485773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acc97c-c4b4-410e-900a-e9e442ac5d44 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:51.486722 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acc97c-c4b4-410e-900a-e9e442ac5d44 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:51.487188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acc97c-c4b4-410e-900a-e9e442ac5d44 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:51.488850 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 680/1352] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:51.494873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd08b0-0fde-449b-9e6b-b9502a96b6e0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:51.495358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd08b0-0fde-449b-9e6b-b9502a96b6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:51.495447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd08b0-0fde-449b-9e6b-b9502a96b6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:51.515360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-84bd08b0-0fde-449b-9e6b-b9502a96b6e0 None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:51.517240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-84bd08b0-0fde-449b-9e6b-b9502a96b6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:51.526955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 673/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:52.093759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=13 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:52.963901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b7ee-fccc-4196-8d5a-ca8341ae5dfc None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:52.964516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b7ee-fccc-4196-8d5a-ca8341ae5dfc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:52.964516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b7ee-fccc-4196-8d5a-ca8341ae5dfc None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:52.965768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 681/1354] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:04:52.970910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c3851-5c7c-406e-a9c6-441e9f61cfe1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:52.971370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c3851-5c7c-406e-a9c6-441e9f61cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:52.971476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c3851-5c7c-406e-a9c6-441e9f61cfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:52.990186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-fc2c3851-5c7c-406e-a9c6-441e9f61cfe1 None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:52.991385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fc2c3851-5c7c-406e-a9c6-441e9f61cfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:53.000723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 674/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:04:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:56.797683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bbe2f-b0b1-438b-9be6-77bae796191c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:56.798628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bbe2f-b0b1-438b-9be6-77bae796191c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:56.799062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bbe2f-b0b1-438b-9be6-77bae796191c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:56.805209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 682/1356] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:56.806435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cfc5a-edfd-4185-8f46-5778fe5f4764 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:56.807224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cfc5a-edfd-4185-8f46-5778fe5f4764 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:56.807664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cfc5a-edfd-4185-8f46-5778fe5f4764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:56.831505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e76cfc5a-edfd-4185-8f46-5778fe5f4764 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:56.832888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e76cfc5a-edfd-4185-8f46-5778fe5f4764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:56.841364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 675/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:56.902061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b176e-d3ed-4636-93ab-276f65438421 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:56.902532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b176e-d3ed-4636-93ab-276f65438421 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:56.903024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b176e-d3ed-4636-93ab-276f65438421 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:56.905002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 683/1358] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 23 17:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:56.914504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdedd2-2fcb-479c-a154-a931a5bef2a0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:56.915178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdedd2-2fcb-479c-a154-a931a5bef2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:56.915655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdedd2-2fcb-479c-a154-a931a5bef2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:56.964209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:04:56.972547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a7fdedd2-2fcb-479c-a154-a931a5bef2a0 None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:56.974242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a7fdedd2-2fcb-479c-a154-a931a5bef2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:57.058557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 676/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 23 17:04:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:57.066589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b176e-d3ed-4636-93ab-276f65438421 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:57.087603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b176e-d3ed-4636-93ab-276f65438421 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:57.095220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992343b-f2bb-4b16-ba81-65d24e9f830e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:57.096240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992343b-f2bb-4b16-ba81-65d24e9f830e service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:57.096812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992343b-f2bb-4b16-ba81-65d24e9f830e service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:57.097309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992343b-f2bb-4b16-ba81-65d24e9f830e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:57.108195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992343b-f2bb-4b16-ba81-65d24e9f830e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:57.111329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992343b-f2bb-4b16-ba81-65d24e9f830e service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:57.124687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 684/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:04:59.352943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab123f-7041-45fd-82d2-853859060612 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:59.353479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab123f-7041-45fd-82d2-853859060612 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:59.353479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab123f-7041-45fd-82d2-853859060612 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:59.355038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 677/1361] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:04:59.360702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30e37-b8df-4a41-b14b-96e414b95ceb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:59.361192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30e37-b8df-4a41-b14b-96e414b95ceb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:59.361283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd30e37-b8df-4a41-b14b-96e414b95ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:59.379555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-dfd30e37-b8df-4a41-b14b-96e414b95ceb None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:04:59.380743 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dfd30e37-b8df-4a41-b14b-96e414b95ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:04:59.389180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 685/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:04:59.433294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab123f-7041-45fd-82d2-853859060612 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:04:59.450550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab123f-7041-45fd-82d2-853859060612 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:04:59.457119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23b7b-8abf-40aa-90cf-daa6e43f3a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:04:59.457982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23b7b-8abf-40aa-90cf-daa6e43f3a44 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:04:59.458335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23b7b-8abf-40aa-90cf-daa6e43f3a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:04:59.458677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23b7b-8abf-40aa-90cf-daa6e43f3a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:04:59.467648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c23b7b-8abf-40aa-90cf-daa6e43f3a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:04:59.469371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c23b7b-8abf-40aa-90cf-daa6e43f3a44 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:04:59.482603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 678/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:01.807500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ca9d-cf79-4f6e-a508-bbaffe46f803 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:01.808020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ca9d-cf79-4f6e-a508-bbaffe46f803 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:01.808138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ca9d-cf79-4f6e-a508-bbaffe46f803 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:01.809420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 686/1364] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:01.814890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74aeb3-c6d9-4139-9d9e-e46407fba8a6 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:01.815342 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74aeb3-c6d9-4139-9d9e-e46407fba8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:01.815430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74aeb3-c6d9-4139-9d9e-e46407fba8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:01.834679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-ab74aeb3-c6d9-4139-9d9e-e46407fba8a6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:01.835870 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ab74aeb3-c6d9-4139-9d9e-e46407fba8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:01.844250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 679/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:01.890270 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d5cd3-21d9-4f04-9d81-056b4908bb44 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:01.892520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d5cd3-21d9-4f04-9d81-056b4908bb44 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:01.892520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d5cd3-21d9-4f04-9d81-056b4908bb44 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:01.892520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 687/1366] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 23 17:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:01.898102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a519b-f32f-4d7b-8283-c206e4db575c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:01.898713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a519b-f32f-4d7b-8283-c206e4db575c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:01.898855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a519b-f32f-4d7b-8283-c206e4db575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:01.918958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d32a519b-f32f-4d7b-8283-c206e4db575c None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:01.920231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d32a519b-f32f-4d7b-8283-c206e4db575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:01.930258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 680/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 23 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:05:01.938382 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d5cd3-21d9-4f04-9d81-056b4908bb44 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:01.954602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d5cd3-21d9-4f04-9d81-056b4908bb44 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:01.960401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6520a1-026d-4ae7-b0e7-9aa83a893e19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:01.961072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6520a1-026d-4ae7-b0e7-9aa83a893e19 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:01.961349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6520a1-026d-4ae7-b0e7-9aa83a893e19 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:01.961621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6520a1-026d-4ae7-b0e7-9aa83a893e19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:01.970334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6520a1-026d-4ae7-b0e7-9aa83a893e19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:01.971959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6520a1-026d-4ae7-b0e7-9aa83a893e19 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:01.981215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 688/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:04.067682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dad10-bd0a-4fde-8bbe-1d64336db386 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:04.068316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dad10-bd0a-4fde-8bbe-1d64336db386 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:04.068316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dad10-bd0a-4fde-8bbe-1d64336db386 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:04.070019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 681/1369] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:04.076011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d17c2-095c-4507-9323-caafeda8bfc2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:04.076505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d17c2-095c-4507-9323-caafeda8bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:04.076698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d17c2-095c-4507-9323-caafeda8bfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:04.095581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cd7d17c2-095c-4507-9323-caafeda8bfc2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:04.096801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cd7d17c2-095c-4507-9323-caafeda8bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:04.105280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 689/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:04.148897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dad10-bd0a-4fde-8bbe-1d64336db386 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:04.165116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dad10-bd0a-4fde-8bbe-1d64336db386 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:04.170984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23ea63-c29c-4324-97fa-e06238eae155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:04.171641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ea63-c29c-4324-97fa-e06238eae155 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:04.172044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ea63-c29c-4324-97fa-e06238eae155 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:04.172326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ea63-c29c-4324-97fa-e06238eae155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:04.182080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23ea63-c29c-4324-97fa-e06238eae155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:04.183806 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23ea63-c29c-4324-97fa-e06238eae155 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:04.195528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 682/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:05.003661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce88f-4b83-4518-abbb-c16d43838744 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:05.004024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce88f-4b83-4518-abbb-c16d43838744 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:05.004552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ce88f-4b83-4518-abbb-c16d43838744 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:05.006232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 690/1372] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:05.011642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c6c73-c946-4116-9894-cbfb226eb224 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:05.011908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c6c73-c946-4116-9894-cbfb226eb224 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:05.012205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c6c73-c946-4116-9894-cbfb226eb224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:05.031043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c48c6c73-c946-4116-9894-cbfb226eb224 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:05.032368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c48c6c73-c946-4116-9894-cbfb226eb224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:05.040483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 683/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:05.391478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fddd04-1aaa-420e-a2f9-3b91fa280883 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:05.391478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fddd04-1aaa-420e-a2f9-3b91fa280883 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:05.391478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fddd04-1aaa-420e-a2f9-3b91fa280883 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:05.396081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 691/1374] 10.222.0.18 () {54 vars in 963 bytes} [Thu Jun 23 17:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:05.398688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b8c69-bffa-4cb2-94bd-3f37a2d36c6e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:05.398688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b8c69-bffa-4cb2-94bd-3f37a2d36c6e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:05.398688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b8c69-bffa-4cb2-94bd-3f37a2d36c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:05.451486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-416b8c69-bffa-4cb2-94bd-3f37a2d36c6e None None] MFA Rules not processed for user `3c8b0c3534b84db68461b426a3f78773`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:05.452908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-416b8c69-bffa-4cb2-94bd-3f37a2d36c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:05.517487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 684/1375] 10.222.0.18 () {58 vars in 1060 bytes} [Thu Jun 23 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:05.525148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fddd04-1aaa-420e-a2f9-3b91fa280883 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:05.537679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fddd04-1aaa-420e-a2f9-3b91fa280883 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:05.541742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcd1f5-f5ec-419f-9ab7-9cd7164e7253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:05.542410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcd1f5-f5ec-419f-9ab7-9cd7164e7253 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:05.542685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcd1f5-f5ec-419f-9ab7-9cd7164e7253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:05.542959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcd1f5-f5ec-419f-9ab7-9cd7164e7253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:05.552818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcd1f5-f5ec-419f-9ab7-9cd7164e7253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:05.554311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcd1f5-f5ec-419f-9ab7-9cd7164e7253 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:05.564091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 692/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:06.274274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29ca7-8e73-4abb-87b9-0daa39f5b70b None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:06.274684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29ca7-8e73-4abb-87b9-0daa39f5b70b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:06.274979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29ca7-8e73-4abb-87b9-0daa39f5b70b None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:06.276742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 685/1377] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:06.281695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7776-2f25-4ec5-83c4-6e92afbe276d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:06.282276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7776-2f25-4ec5-83c4-6e92afbe276d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:06.282609 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7776-2f25-4ec5-83c4-6e92afbe276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:06.302695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-adcd7776-2f25-4ec5-83c4-6e92afbe276d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:06.303909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-adcd7776-2f25-4ec5-83c4-6e92afbe276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:06.314193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 693/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:06.357987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb29ca7-8e73-4abb-87b9-0daa39f5b70b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:06.379381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb29ca7-8e73-4abb-87b9-0daa39f5b70b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:06.387401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be7d57-97bb-4a96-b427-b9509e40f208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:06.388911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7d57-97bb-4a96-b427-b9509e40f208 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:06.389582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7d57-97bb-4a96-b427-b9509e40f208 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:06.390081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be7d57-97bb-4a96-b427-b9509e40f208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:06.401706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be7d57-97bb-4a96-b427-b9509e40f208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:06.406209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be7d57-97bb-4a96-b427-b9509e40f208 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:06.414899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:05:06.423726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 686/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:08.481686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78989188-9512-424a-80c2-236f69ad7587 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:08.482243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78989188-9512-424a-80c2-236f69ad7587 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:08.482368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78989188-9512-424a-80c2-236f69ad7587 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:08.483764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 694/1380] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:08.489312 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7011f0-a67c-4117-a28f-a6fd4666ad77 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:08.489738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7011f0-a67c-4117-a28f-a6fd4666ad77 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:08.489992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7011f0-a67c-4117-a28f-a6fd4666ad77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:08.509722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-cf7011f0-a67c-4117-a28f-a6fd4666ad77 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:08.510951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-cf7011f0-a67c-4117-a28f-a6fd4666ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:08.522368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 687/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:08.566707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78989188-9512-424a-80c2-236f69ad7587 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:08.583158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78989188-9512-424a-80c2-236f69ad7587 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:08.589430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2f53-a4f1-4fd4-ae09-66da537710ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:08.590332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2f53-a4f1-4fd4-ae09-66da537710ea service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:08.590819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2f53-a4f1-4fd4-ae09-66da537710ea service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:08.591277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2f53-a4f1-4fd4-ae09-66da537710ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:08.602107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd2f53-a4f1-4fd4-ae09-66da537710ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:08.603937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd2f53-a4f1-4fd4-ae09-66da537710ea service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:08.620804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 695/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:10.708598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5afc5-6d3e-4392-8c1b-0f1b911ec841 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:10.709173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5afc5-6d3e-4392-8c1b-0f1b911ec841 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:10.709403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5afc5-6d3e-4392-8c1b-0f1b911ec841 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:10.711105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 688/1383] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:10.716748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7c947-64f7-4c62-9e86-6b22fd8fcbc7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:10.717208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7c947-64f7-4c62-9e86-6b22fd8fcbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:10.717505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7c947-64f7-4c62-9e86-6b22fd8fcbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:10.737839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e6d7c947-64f7-4c62-9e86-6b22fd8fcbc7 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:10.739234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6d7c947-64f7-4c62-9e86-6b22fd8fcbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:10.748280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 696/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:05:10.791095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5afc5-6d3e-4392-8c1b-0f1b911ec841 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:10.807289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5afc5-6d3e-4392-8c1b-0f1b911ec841 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:10.812736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f80731-f0c3-4f76-8784-f648833156e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:10.813577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f80731-f0c3-4f76-8784-f648833156e1 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:10.813901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f80731-f0c3-4f76-8784-f648833156e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:10.814182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f80731-f0c3-4f76-8784-f648833156e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:10.824126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f80731-f0c3-4f76-8784-f648833156e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:10.825728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f80731-f0c3-4f76-8784-f648833156e1 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:10.835967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 689/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:12.908313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cca28-82ed-40c8-9956-8ef9919ccaea None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:12.908313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cca28-82ed-40c8-9956-8ef9919ccaea None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:12.909350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cca28-82ed-40c8-9956-8ef9919ccaea None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:12.915633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d857c-7b11-4f4b-9e83-a3faaeeebe1f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:12.916230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d857c-7b11-4f4b-9e83-a3faaeeebe1f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:12.916230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d857c-7b11-4f4b-9e83-a3faaeeebe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:12.918678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 697/1386] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:12.954009 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-437d857c-7b11-4f4b-9e83-a3faaeeebe1f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:12.955211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-437d857c-7b11-4f4b-9e83-a3faaeeebe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:12.969233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 690/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:13.014347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cca28-82ed-40c8-9956-8ef9919ccaea None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:13.029888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cca28-82ed-40c8-9956-8ef9919ccaea None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:13.035453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52016b96-1cbe-4882-a4d3-eabecae38276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:13.036236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016b96-1cbe-4882-a4d3-eabecae38276 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:13.036517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016b96-1cbe-4882-a4d3-eabecae38276 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:13.036790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016b96-1cbe-4882-a4d3-eabecae38276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:13.045561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52016b96-1cbe-4882-a4d3-eabecae38276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:13.047239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52016b96-1cbe-4882-a4d3-eabecae38276 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:13.057358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 698/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:15.691599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84cbd-5070-4048-aeb9-5366340258fa None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:15.692150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84cbd-5070-4048-aeb9-5366340258fa None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:15.692150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c84cbd-5070-4048-aeb9-5366340258fa None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:15.693825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 691/1389] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:05:15.700616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769da7-23f4-446a-8849-7929d0f3a1c0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:15.701079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769da7-23f4-446a-8849-7929d0f3a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:15.701304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769da7-23f4-446a-8849-7929d0f3a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:15.721452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e0769da7-23f4-446a-8849-7929d0f3a1c0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:15.722704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e0769da7-23f4-446a-8849-7929d0f3a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:15.731575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 699/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:15.776823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c84cbd-5070-4048-aeb9-5366340258fa None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:15.793111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c84cbd-5070-4048-aeb9-5366340258fa None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:15.799360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d75fdd-8e8c-41b7-80de-0070e218af15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:15.800043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d75fdd-8e8c-41b7-80de-0070e218af15 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:15.800345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d75fdd-8e8c-41b7-80de-0070e218af15 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:15.800627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d75fdd-8e8c-41b7-80de-0070e218af15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:15.810251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d75fdd-8e8c-41b7-80de-0070e218af15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:15.811916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d75fdd-8e8c-41b7-80de-0070e218af15 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:15.822800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 692/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:17.919002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331a89-d640-4673-a519-9e38ef83d531 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:17.919580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331a89-d640-4673-a519-9e38ef83d531 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:17.919580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331a89-d640-4673-a519-9e38ef83d531 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:17.921037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 700/1392] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:17.927038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a587c-820a-4b10-92bf-97ef6799a551 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:17.927781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a587c-820a-4b10-92bf-97ef6799a551 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:17.927781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a587c-820a-4b10-92bf-97ef6799a551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:17.947420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4a2a587c-820a-4b10-92bf-97ef6799a551 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:17.948591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4a2a587c-820a-4b10-92bf-97ef6799a551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:17.958582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 693/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:18.004243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14331a89-d640-4673-a519-9e38ef83d531 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:18.020842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14331a89-d640-4673-a519-9e38ef83d531 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:18.026850 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d95c-b189-4f33-95dc-5b91ae0460f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:18.027544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d95c-b189-4f33-95dc-5b91ae0460f7 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:18.027912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d95c-b189-4f33-95dc-5b91ae0460f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:18.028185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d95c-b189-4f33-95dc-5b91ae0460f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:18.037188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d95c-b189-4f33-95dc-5b91ae0460f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:18.038811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d95c-b189-4f33-95dc-5b91ae0460f7 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:18.051904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 701/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:20.117308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b002a-1a02-4a10-800b-36b2670f3008 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:20.117906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b002a-1a02-4a10-800b-36b2670f3008 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:20.117906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b002a-1a02-4a10-800b-36b2670f3008 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:20.119258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 694/1395] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:20.124704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d734-a3c7-4141-9f93-ebdc421889d2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:20.125172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d734-a3c7-4141-9f93-ebdc421889d2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:20.125555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d734-a3c7-4141-9f93-ebdc421889d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:20.145809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4400d734-a3c7-4141-9f93-ebdc421889d2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:20.147054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4400d734-a3c7-4141-9f93-ebdc421889d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:20.155889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 702/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:20.200905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b002a-1a02-4a10-800b-36b2670f3008 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:20.217053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b002a-1a02-4a10-800b-36b2670f3008 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:20.223462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394b779-76eb-4d0a-b5b9-7104be56ef5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:20.224101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394b779-76eb-4d0a-b5b9-7104be56ef5a service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:20.224378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394b779-76eb-4d0a-b5b9-7104be56ef5a service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:20.224645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394b779-76eb-4d0a-b5b9-7104be56ef5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:20.233005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394b779-76eb-4d0a-b5b9-7104be56ef5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:20.234750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394b779-76eb-4d0a-b5b9-7104be56ef5a service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:20.244565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 695/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:20.603359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13dbf-b482-4a6b-b703-4667a75763ef None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:20.603605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13dbf-b482-4a6b-b703-4667a75763ef None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:20.603909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13dbf-b482-4a6b-b703-4667a75763ef None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:20.605301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 703/1398] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:05:20.610875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de752548-d3ab-46ff-a67c-e500184d08f1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:20.611159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de752548-d3ab-46ff-a67c-e500184d08f1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:20.611431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de752548-d3ab-46ff-a67c-e500184d08f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:20.630032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-de752548-d3ab-46ff-a67c-e500184d08f1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:20.631237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-de752548-d3ab-46ff-a67c-e500184d08f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:20.640197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 696/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:20.697520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810146-441b-4241-9222-82554289b1d0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:20.697826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810146-441b-4241-9222-82554289b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:20.698126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810146-441b-4241-9222-82554289b1d0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:20.699488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 704/1400] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jun 23 17:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:20.704902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81fd4-d7e4-4c48-a632-9a779a601f4e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:20.705163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81fd4-d7e4-4c48-a632-9a779a601f4e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:20.705459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81fd4-d7e4-4c48-a632-9a779a601f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:20.757136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-12d81fd4-d7e4-4c48-a632-9a779a601f4e None None] MFA Rules not processed for user `9c211cd37d7f49eaa916d332580135c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:20.758358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-12d81fd4-d7e4-4c48-a632-9a779a601f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:20.817569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 697/1401] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jun 23 17:05:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:20.825707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810146-441b-4241-9222-82554289b1d0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:20.836600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810146-441b-4241-9222-82554289b1d0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:20.840142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a402822-fb14-48f7-be96-009f9b379243 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c211cd37d7f49eaa916d332580135c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:20.840777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a402822-fb14-48f7-be96-009f9b379243 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:20.841053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a402822-fb14-48f7-be96-009f9b379243 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:20.841324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a402822-fb14-48f7-be96-009f9b379243 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:20.851069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a402822-fb14-48f7-be96-009f9b379243 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:20.852519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a402822-fb14-48f7-be96-009f9b379243 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:20.862051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 705/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:21.586724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4403bf-ec49-4eee-af9c-9dff162f7d36 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:21.587225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4403bf-ec49-4eee-af9c-9dff162f7d36 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:21.587476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4403bf-ec49-4eee-af9c-9dff162f7d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:21.638198 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-6a4403bf-ec49-4eee-af9c-9dff162f7d36 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:21.639421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6a4403bf-ec49-4eee-af9c-9dff162f7d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:21.680609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:05:21.714265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 698/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:05:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:21.758219 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e653b-db73-4b6a-bd44-e4b7c2ed49d9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:21.758786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e653b-db73-4b6a-bd44-e4b7c2ed49d9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:21.759060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e653b-db73-4b6a-bd44-e4b7c2ed49d9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:21.760527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 706/1404] 10.222.0.18 () {54 vars in 942 bytes} [Thu Jun 23 17:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:21.767616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd9ff3-159f-4fb0-aff6-979c83ec618f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:21.767784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd9ff3-159f-4fb0-aff6-979c83ec618f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:21.768092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd9ff3-159f-4fb0-aff6-979c83ec618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:21.818154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2dbd9ff3-159f-4fb0-aff6-979c83ec618f None None] MFA Rules not processed for user `08ffc7cdb0d54083bbedaa3e7441e099`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:21.819381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2dbd9ff3-159f-4fb0-aff6-979c83ec618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:21.893939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 699/1405] 10.222.0.18 () {58 vars in 1039 bytes} [Thu Jun 23 17:05:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:21.903199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e653b-db73-4b6a-bd44-e4b7c2ed49d9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:21.917116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e653b-db73-4b6a-bd44-e4b7c2ed49d9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:21.922407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b9b0b-860d-48f5-aec7-1bc8d758334f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:21.923243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9b0b-860d-48f5-aec7-1bc8d758334f service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:21.923590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9b0b-860d-48f5-aec7-1bc8d758334f service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:21.923928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9b0b-860d-48f5-aec7-1bc8d758334f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:21.932298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b9b0b-860d-48f5-aec7-1bc8d758334f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:21.934041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b9b0b-860d-48f5-aec7-1bc8d758334f service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:21.942432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 707/1406] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:05:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:05:22.309937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9884d7f-2ba2-4376-aafa-3adbb9c086d9 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:22.310232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9884d7f-2ba2-4376-aafa-3adbb9c086d9 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:22.310513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9884d7f-2ba2-4376-aafa-3adbb9c086d9 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:22.311922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 700/1407] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:22.317439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c68a8-1865-4e55-9278-bb0f1103174b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:22.317727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c68a8-1865-4e55-9278-bb0f1103174b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:22.318047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c68a8-1865-4e55-9278-bb0f1103174b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:22.324504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=67 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:05:22.338014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-699c68a8-1865-4e55-9278-bb0f1103174b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:22.339358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-699c68a8-1865-4e55-9278-bb0f1103174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:22.349447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 708/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:05:22.400421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9884d7f-2ba2-4376-aafa-3adbb9c086d9 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:22.416917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9884d7f-2ba2-4376-aafa-3adbb9c086d9 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:22.424753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4276df7-0d77-4be7-8cb6-b76c944d1ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:22.424753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4276df7-0d77-4be7-8cb6-b76c944d1ace service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:22.424753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4276df7-0d77-4be7-8cb6-b76c944d1ace service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:22.424753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4276df7-0d77-4be7-8cb6-b76c944d1ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:22.433406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4276df7-0d77-4be7-8cb6-b76c944d1ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:22.435192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4276df7-0d77-4be7-8cb6-b76c944d1ace service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:22.446037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 701/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:32.332570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:05:32.441108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=59 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:05:44.140202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde68f8-83d0-42e2-bb81-f42b6e5c708c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:44.140835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde68f8-83d0-42e2-bb81-f42b6e5c708c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:44.140835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde68f8-83d0-42e2-bb81-f42b6e5c708c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:44.142495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 709/1410] 10.222.0.18 () {54 vars in 918 bytes} [Thu Jun 23 17:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:44.148793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6acc28-2615-4edb-8304-b94a4e3647e5 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:44.149265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6acc28-2615-4edb-8304-b94a4e3647e5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:44.149371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6acc28-2615-4edb-8304-b94a4e3647e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:44.176027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0e6acc28-2615-4edb-8304-b94a4e3647e5 None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:44.177247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0e6acc28-2615-4edb-8304-b94a4e3647e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:44.185953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 702/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jun 23 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:44.206845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4d891-a192-4e3e-a2ba-06d34cf0d27f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:44.207134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4d891-a192-4e3e-a2ba-06d34cf0d27f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:44.207406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4d891-a192-4e3e-a2ba-06d34cf0d27f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:44.208764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 710/1412] 10.222.0.18 () {54 vars in 918 bytes} [Thu Jun 23 17:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:44.213504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adea84-6ee6-45fc-aba1-d95d29027aa6 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:44.213786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adea84-6ee6-45fc-aba1-d95d29027aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:44.214093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adea84-6ee6-45fc-aba1-d95d29027aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:44.234304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b4adea84-6ee6-45fc-aba1-d95d29027aa6 None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:44.235767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b4adea84-6ee6-45fc-aba1-d95d29027aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:44.245526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 703/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jun 23 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:46.751783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa9cd-8211-4297-bc7e-9d55f788af84 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:46.752351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa9cd-8211-4297-bc7e-9d55f788af84 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:46.752351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5caa9cd-8211-4297-bc7e-9d55f788af84 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:46.754462 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:05:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:46.760610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8652a6-4ca5-4a33-bfa0-1fecb923a756 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:46.761068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8652a6-4ca5-4a33-bfa0-1fecb923a756 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:46.761259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8652a6-4ca5-4a33-bfa0-1fecb923a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:46.787594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-ef8652a6-4ca5-4a33-bfa0-1fecb923a756 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:46.788804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ef8652a6-4ca5-4a33-bfa0-1fecb923a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:46.797092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:05:46.841105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5caa9cd-8211-4297-bc7e-9d55f788af84 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:46.860492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5caa9cd-8211-4297-bc7e-9d55f788af84 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:46.867865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df54f0-b4e7-409e-93c4-7fb922650f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:46.868527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df54f0-b4e7-409e-93c4-7fb922650f88 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:46.868812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df54f0-b4e7-409e-93c4-7fb922650f88 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:46.869084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df54f0-b4e7-409e-93c4-7fb922650f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:46.878518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df54f0-b4e7-409e-93c4-7fb922650f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:46.880101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df54f0-b4e7-409e-93c4-7fb922650f88 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:46.889837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 712/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:47.828567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3ded-bc02-4786-b2a5-025c0dcbcab8 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:47.829443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3ded-bc02-4786-b2a5-025c0dcbcab8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:47.829443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3ded-bc02-4786-b2a5-025c0dcbcab8 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:47.831060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:05:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:47.836395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87cbe-fc6c-465a-b9c5-48dccfc4cee5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:47.836852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87cbe-fc6c-465a-b9c5-48dccfc4cee5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:47.836956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87cbe-fc6c-465a-b9c5-48dccfc4cee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:47.855261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e2c87cbe-fc6c-465a-b9c5-48dccfc4cee5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:47.856455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e2c87cbe-fc6c-465a-b9c5-48dccfc4cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:47.865118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:48.014272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3ded-bc02-4786-b2a5-025c0dcbcab8 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:48.032875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3ded-bc02-4786-b2a5-025c0dcbcab8 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:48.039818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6edc00-6b82-4be5-815d-86fd07c3a04f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:48.040453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6edc00-6b82-4be5-815d-86fd07c3a04f service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:48.040706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6edc00-6b82-4be5-815d-86fd07c3a04f service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:48.040970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6edc00-6b82-4be5-815d-86fd07c3a04f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:48.050129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6edc00-6b82-4be5-815d-86fd07c3a04f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:48.051719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6edc00-6b82-4be5-815d-86fd07c3a04f service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:48.061812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 706/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:48.975031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f09ae-3ba2-4d15-aad4-9fd55113d7ff None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:48.975604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f09ae-3ba2-4d15-aad4-9fd55113d7ff None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:48.975604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f09ae-3ba2-4d15-aad4-9fd55113d7ff None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:48.976814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:05:48.982942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b4d9e-12c1-4e8b-8742-72b80a1eaca0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:48.983405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b4d9e-12c1-4e8b-8742-72b80a1eaca0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:48.983502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b4d9e-12c1-4e8b-8742-72b80a1eaca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:49.012282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9e5b4d9e-12c1-4e8b-8742-72b80a1eaca0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:49.014137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9e5b4d9e-12c1-4e8b-8742-72b80a1eaca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:49.028006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:49.186035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f09ae-3ba2-4d15-aad4-9fd55113d7ff None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:49.203529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f09ae-3ba2-4d15-aad4-9fd55113d7ff None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:49.209434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd1d30-bef1-48d0-b754-dee0b8892c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:49.210104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1d30-bef1-48d0-b754-dee0b8892c1c service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:49.210391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1d30-bef1-48d0-b754-dee0b8892c1c service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:49.210639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1d30-bef1-48d0-b754-dee0b8892c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:49.218876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd1d30-bef1-48d0-b754-dee0b8892c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:49.220606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd1d30-bef1-48d0-b754-dee0b8892c1c service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:49.230772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 715/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:50.115856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37811e-a4de-4b81-b259-7202185657b6 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:50.116478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37811e-a4de-4b81-b259-7202185657b6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:50.116478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37811e-a4de-4b81-b259-7202185657b6 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:50.117853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:50.126142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d835a-69b5-454e-840a-4e38b8025a93 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:50.126598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d835a-69b5-454e-840a-4e38b8025a93 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:50.126890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d835a-69b5-454e-840a-4e38b8025a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:50.151945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b53d835a-69b5-454e-840a-4e38b8025a93 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:50.153162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b53d835a-69b5-454e-840a-4e38b8025a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:50.162419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:50.315668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37811e-a4de-4b81-b259-7202185657b6 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:50.338107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37811e-a4de-4b81-b259-7202185657b6 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:50.344270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb4696-b225-4acf-af7e-04b5a7f3da2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:50.344910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4696-b225-4acf-af7e-04b5a7f3da2f service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:50.345193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4696-b225-4acf-af7e-04b5a7f3da2f service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:50.345554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4696-b225-4acf-af7e-04b5a7f3da2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:50.354202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb4696-b225-4acf-af7e-04b5a7f3da2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:50.355787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb4696-b225-4acf-af7e-04b5a7f3da2f service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:50.369024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 709/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:51.222665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253688f5-0be8-4866-a0c1-9f04e1dd595d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:51.223787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253688f5-0be8-4866-a0c1-9f04e1dd595d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:51.223787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253688f5-0be8-4866-a0c1-9f04e1dd595d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:51.225835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:05:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:51.231945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3611aa-fca7-4101-8216-2c7831cb3a01 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:51.232674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3611aa-fca7-4101-8216-2c7831cb3a01 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:51.232864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3611aa-fca7-4101-8216-2c7831cb3a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:51.259355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-8a3611aa-fca7-4101-8216-2c7831cb3a01 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:51.260624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8a3611aa-fca7-4101-8216-2c7831cb3a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:51.270820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:51.424230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253688f5-0be8-4866-a0c1-9f04e1dd595d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:51.446691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253688f5-0be8-4866-a0c1-9f04e1dd595d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:51.453109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51498b-d0d3-4da2-8100-df1b90d285fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:51.453749 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51498b-d0d3-4da2-8100-df1b90d285fe service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:51.454063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51498b-d0d3-4da2-8100-df1b90d285fe service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:51.454337 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51498b-d0d3-4da2-8100-df1b90d285fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:51.462758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51498b-d0d3-4da2-8100-df1b90d285fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:51.464367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51498b-d0d3-4da2-8100-df1b90d285fe service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:51.474412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 718/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:52.274844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e79bc-2210-4a05-a44f-429c259b940d None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:52.275440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e79bc-2210-4a05-a44f-429c259b940d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:52.275440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e79bc-2210-4a05-a44f-429c259b940d None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:52.277558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:05:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:52.285397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18764-dbb6-4e5e-b248-57cfec1078cc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:52.285875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18764-dbb6-4e5e-b248-57cfec1078cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:52.286002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18764-dbb6-4e5e-b248-57cfec1078cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:52.307747 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ebf18764-dbb6-4e5e-b248-57cfec1078cc None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:52.308956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ebf18764-dbb6-4e5e-b248-57cfec1078cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:52.317748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:52.470319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e79bc-2210-4a05-a44f-429c259b940d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:52.493740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e79bc-2210-4a05-a44f-429c259b940d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:52.500266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1b8f8-7a32-4a5a-9fac-910c8115694d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:52.500914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1b8f8-7a32-4a5a-9fac-910c8115694d service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:52.501199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1b8f8-7a32-4a5a-9fac-910c8115694d service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:52.501478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1b8f8-7a32-4a5a-9fac-910c8115694d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:52.510814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1b8f8-7a32-4a5a-9fac-910c8115694d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:52.512434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1b8f8-7a32-4a5a-9fac-910c8115694d service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:52.522679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 712/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:53.330134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da040f-4bbb-4207-be6e-fa4be1c066e5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:53.330736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da040f-4bbb-4207-be6e-fa4be1c066e5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:53.330736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da040f-4bbb-4207-be6e-fa4be1c066e5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:53.332089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:53.338298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f649a3-2fcb-44de-8b26-39229d7fe55b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:53.339017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f649a3-2fcb-44de-8b26-39229d7fe55b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:53.339226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f649a3-2fcb-44de-8b26-39229d7fe55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:53.366393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-63f649a3-2fcb-44de-8b26-39229d7fe55b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:53.367609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-63f649a3-2fcb-44de-8b26-39229d7fe55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:53.376524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:53.533847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da040f-4bbb-4207-be6e-fa4be1c066e5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:53.550457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da040f-4bbb-4207-be6e-fa4be1c066e5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:53.558070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc293144-3865-4e77-bc0f-43f4622ca904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:53.558719 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293144-3865-4e77-bc0f-43f4622ca904 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:53.559001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293144-3865-4e77-bc0f-43f4622ca904 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:53.559276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293144-3865-4e77-bc0f-43f4622ca904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:53.568239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc293144-3865-4e77-bc0f-43f4622ca904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:53.569863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc293144-3865-4e77-bc0f-43f4622ca904 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:53.580228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 721/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:54.395793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7051-3b17-4bcc-a2f8-59be551d759c None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:54.396485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7051-3b17-4bcc-a2f8-59be551d759c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:54.396485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7051-3b17-4bcc-a2f8-59be551d759c None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:54.397722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:54.403753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6eb3e-306a-4cc2-b53c-46590ea1ba19 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:54.404336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6eb3e-306a-4cc2-b53c-46590ea1ba19 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:54.404429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6eb3e-306a-4cc2-b53c-46590ea1ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:54.425041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8af6eb3e-306a-4cc2-b53c-46590ea1ba19 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:54.426310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8af6eb3e-306a-4cc2-b53c-46590ea1ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:54.435622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:54.587657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7051-3b17-4bcc-a2f8-59be551d759c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:54.613551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7051-3b17-4bcc-a2f8-59be551d759c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:54.620303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719ea45-a336-4487-b648-bd86ddce9319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:54.620947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ea45-a336-4487-b648-bd86ddce9319 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:54.621229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ea45-a336-4487-b648-bd86ddce9319 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:54.621500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ea45-a336-4487-b648-bd86ddce9319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:54.630129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719ea45-a336-4487-b648-bd86ddce9319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:54.632049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719ea45-a336-4487-b648-bd86ddce9319 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:54.644839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 715/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:55.454831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377412b-5828-45d5-879a-506a576e8b0e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:55.455859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377412b-5828-45d5-879a-506a576e8b0e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:55.455859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377412b-5828-45d5-879a-506a576e8b0e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:55.456675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:55.462959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6501a0-6df9-4147-b5ec-7531cdcb2e5c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:55.463424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6501a0-6df9-4147-b5ec-7531cdcb2e5c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:55.463564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6501a0-6df9-4147-b5ec-7531cdcb2e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:55.491612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-dd6501a0-6df9-4147-b5ec-7531cdcb2e5c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:55.492820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-dd6501a0-6df9-4147-b5ec-7531cdcb2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:55.501946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:55.658826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377412b-5828-45d5-879a-506a576e8b0e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:55.683067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377412b-5828-45d5-879a-506a576e8b0e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:55.689629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19567625-8a03-4485-bd64-fccca47a948c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:55.690335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19567625-8a03-4485-bd64-fccca47a948c service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:55.690626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19567625-8a03-4485-bd64-fccca47a948c service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:55.690875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19567625-8a03-4485-bd64-fccca47a948c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:55.699944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19567625-8a03-4485-bd64-fccca47a948c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:55.701546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19567625-8a03-4485-bd64-fccca47a948c service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:55.711043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 724/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:57.625499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f76cb2-756c-4db8-8bec-54515b5148c2 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:57.626440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f76cb2-756c-4db8-8bec-54515b5148c2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:57.626440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f76cb2-756c-4db8-8bec-54515b5148c2 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:57.628742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:05:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:57.637447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc3973-e895-4dc4-8d0a-f95e94bcc3e6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:57.638312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc3973-e895-4dc4-8d0a-f95e94bcc3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:57.638558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc3973-e895-4dc4-8d0a-f95e94bcc3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:57.659482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f7bc3973-e895-4dc4-8d0a-f95e94bcc3e6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:05:57.660701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f7bc3973-e895-4dc4-8d0a-f95e94bcc3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:05:57.669295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:05:57.708791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f76cb2-756c-4db8-8bec-54515b5148c2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:05:57.721600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f76cb2-756c-4db8-8bec-54515b5148c2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:05:57.725917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fa2fc-1b4a-4f08-a093-c9e38fade99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:05:57.726561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa2fc-1b4a-4f08-a093-c9e38fade99c service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:57.726836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa2fc-1b4a-4f08-a093-c9e38fade99c service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:57.727101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fa2fc-1b4a-4f08-a093-c9e38fade99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:57.738400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fa2fc-1b4a-4f08-a093-c9e38fade99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:05:57.739839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fa2fc-1b4a-4f08-a093-c9e38fade99c service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:05:57.750124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 718/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:05:59.966803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed13f-8ef7-4953-9171-ea9916ffe1ce None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:59.967351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed13f-8ef7-4953-9171-ea9916ffe1ce None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:59.967351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed13f-8ef7-4953-9171-ea9916ffe1ce None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:59.969429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:05:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:05:59.977520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d20-ef89-490b-817f-049ce42305f8 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:05:59.978006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d20-ef89-490b-817f-049ce42305f8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:05:59.978122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d20-ef89-490b-817f-049ce42305f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:05:59.999168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d2089d20-ef89-490b-817f-049ce42305f8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:00.000381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d2089d20-ef89-490b-817f-049ce42305f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:00.009825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:06:00.048872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed13f-8ef7-4953-9171-ea9916ffe1ce None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:00.066612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed13f-8ef7-4953-9171-ea9916ffe1ce None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:00.073175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8bef-27a8-4433-8ec5-d3a8e9f81eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:00.074036 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8bef-27a8-4433-8ec5-d3a8e9f81eae service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:00.074385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8bef-27a8-4433-8ec5-d3a8e9f81eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:00.074726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8bef-27a8-4433-8ec5-d3a8e9f81eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:00.086414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8bef-27a8-4433-8ec5-d3a8e9f81eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:00.087872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8bef-27a8-4433-8ec5-d3a8e9f81eae service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:00.098218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 727/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:02.475785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a5e5-b718-46aa-85ef-15a72b011a7a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:02.476650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a5e5-b718-46aa-85ef-15a72b011a7a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:02.476650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a5e5-b718-46aa-85ef-15a72b011a7a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:02.478882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:06:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:02.484439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affee02c-b185-4452-93d9-03fe2f4edab9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:02.484876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affee02c-b185-4452-93d9-03fe2f4edab9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:02.484998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affee02c-b185-4452-93d9-03fe2f4edab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:02.508119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-affee02c-b185-4452-93d9-03fe2f4edab9 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:02.509338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-affee02c-b185-4452-93d9-03fe2f4edab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:02.518541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:02.557641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23a5e5-b718-46aa-85ef-15a72b011a7a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:02.570051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23a5e5-b718-46aa-85ef-15a72b011a7a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:02.574200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4362-fae3-4c4e-b921-df08ebe9d189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:02.574843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4362-fae3-4c4e-b921-df08ebe9d189 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:02.575128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4362-fae3-4c4e-b921-df08ebe9d189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:02.575404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4362-fae3-4c4e-b921-df08ebe9d189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:02.585286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4362-fae3-4c4e-b921-df08ebe9d189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:02.586760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4362-fae3-4c4e-b921-df08ebe9d189 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:02.596863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 721/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:04.754510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc6708-888d-4b54-a6be-a5fbf479e31f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:04.755028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc6708-888d-4b54-a6be-a5fbf479e31f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:04.755028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc6708-888d-4b54-a6be-a5fbf479e31f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:04.756441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:04.761948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dddd4-fbf5-4e1a-ab63-fed853e298f4 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:04.762363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dddd4-fbf5-4e1a-ab63-fed853e298f4 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:04.762525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dddd4-fbf5-4e1a-ab63-fed853e298f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:04.780865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-427dddd4-fbf5-4e1a-ab63-fed853e298f4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:04.782133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-427dddd4-fbf5-4e1a-ab63-fed853e298f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:04.790320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:06:04.831476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc6708-888d-4b54-a6be-a5fbf479e31f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:04.846323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc6708-888d-4b54-a6be-a5fbf479e31f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:04.850101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20324c5-99f7-4a52-8ab1-276c52e65636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:04.850738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20324c5-99f7-4a52-8ab1-276c52e65636 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:04.851030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20324c5-99f7-4a52-8ab1-276c52e65636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:04.851306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20324c5-99f7-4a52-8ab1-276c52e65636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:04.862082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20324c5-99f7-4a52-8ab1-276c52e65636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:04.863564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20324c5-99f7-4a52-8ab1-276c52e65636 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:04.874129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 730/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:06.952859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692ef41-5830-41e7-b31c-20dd07ac8625 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:06.953708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692ef41-5830-41e7-b31c-20dd07ac8625 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:06.953708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692ef41-5830-41e7-b31c-20dd07ac8625 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:06.956470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:06:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:06.962018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bddb37-0da3-4da5-a32a-53ac9bb093d4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:06.962471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bddb37-0da3-4da5-a32a-53ac9bb093d4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:06.962569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bddb37-0da3-4da5-a32a-53ac9bb093d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:06.981468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f5bddb37-0da3-4da5-a32a-53ac9bb093d4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:06.982758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f5bddb37-0da3-4da5-a32a-53ac9bb093d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:06.991746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:07.032698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692ef41-5830-41e7-b31c-20dd07ac8625 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:07.050685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692ef41-5830-41e7-b31c-20dd07ac8625 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:07.054564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da896f-a5a4-4011-a955-445b5e74a689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:07.055205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da896f-a5a4-4011-a955-445b5e74a689 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:07.055482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da896f-a5a4-4011-a955-445b5e74a689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:07.055750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da896f-a5a4-4011-a955-445b5e74a689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:07.064930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da896f-a5a4-4011-a955-445b5e74a689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:07.066413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da896f-a5a4-4011-a955-445b5e74a689 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:07.076144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 724/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:09.155992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1e1c0-2bd7-4c29-b699-657ee53b98ba None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:09.156598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1e1c0-2bd7-4c29-b699-657ee53b98ba None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:09.156598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1e1c0-2bd7-4c29-b699-657ee53b98ba None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:09.158498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:06:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:09.164976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dd3f-f9da-44f6-86dc-159755c7734a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:09.165398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dd3f-f9da-44f6-86dc-159755c7734a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:09.165559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dd3f-f9da-44f6-86dc-159755c7734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:09.185487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c4c8dd3f-f9da-44f6-86dc-159755c7734a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:09.186763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c4c8dd3f-f9da-44f6-86dc-159755c7734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:09.196329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:09.248009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1e1c0-2bd7-4c29-b699-657ee53b98ba None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:09.266202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1e1c0-2bd7-4c29-b699-657ee53b98ba None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:09.271162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300740aa-bf25-4f02-94e6-8016fc6be33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:09.271804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300740aa-bf25-4f02-94e6-8016fc6be33d service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:09.272082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300740aa-bf25-4f02-94e6-8016fc6be33d service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:09.272353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300740aa-bf25-4f02-94e6-8016fc6be33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:09.281979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300740aa-bf25-4f02-94e6-8016fc6be33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:09.283464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300740aa-bf25-4f02-94e6-8016fc6be33d service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:09.293152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 733/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:11.380584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98261dc0-7ace-4530-9175-cda3c10e4c85 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:11.381459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98261dc0-7ace-4530-9175-cda3c10e4c85 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:11.381459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98261dc0-7ace-4530-9175-cda3c10e4c85 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:11.383569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:06:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:11.392346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133351c-7550-46a1-9889-c40b58cc63de None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:11.392769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133351c-7550-46a1-9889-c40b58cc63de None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:11.392913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133351c-7550-46a1-9889-c40b58cc63de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:11.418484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6133351c-7550-46a1-9889-c40b58cc63de None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:11.419692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6133351c-7550-46a1-9889-c40b58cc63de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:11.429423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:11.470987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98261dc0-7ace-4530-9175-cda3c10e4c85 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:11.489992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98261dc0-7ace-4530-9175-cda3c10e4c85 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:11.494790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe52e5-86c7-44e7-8fd4-7dd01a42ce22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:11.495440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe52e5-86c7-44e7-8fd4-7dd01a42ce22 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:11.495720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe52e5-86c7-44e7-8fd4-7dd01a42ce22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:11.495993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe52e5-86c7-44e7-8fd4-7dd01a42ce22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:11.507850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe52e5-86c7-44e7-8fd4-7dd01a42ce22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:11.510208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe52e5-86c7-44e7-8fd4-7dd01a42ce22 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:11.523059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 727/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:13.580212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84322e-56c3-4905-8741-7f58f74e55a2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:13.581129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84322e-56c3-4905-8741-7f58f74e55a2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:13.581129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84322e-56c3-4905-8741-7f58f74e55a2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:13.583767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:06:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:13.592819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50abdd5-c3e1-463c-a367-c39e5a77c74d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:13.593262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50abdd5-c3e1-463c-a367-c39e5a77c74d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:13.593398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50abdd5-c3e1-463c-a367-c39e5a77c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:13.602043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=79 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:06:13.619821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e50abdd5-c3e1-463c-a367-c39e5a77c74d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:13.621606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e50abdd5-c3e1-463c-a367-c39e5a77c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:13.632297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:13.683839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84322e-56c3-4905-8741-7f58f74e55a2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:13.691777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=73 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:06:13.702762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84322e-56c3-4905-8741-7f58f74e55a2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:13.708328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d6d99-fd1c-4320-aee3-0213c4d80631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:13.708987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6d99-fd1c-4320-aee3-0213c4d80631 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:13.709268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6d99-fd1c-4320-aee3-0213c4d80631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:13.709541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6d99-fd1c-4320-aee3-0213c4d80631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:13.720158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d6d99-fd1c-4320-aee3-0213c4d80631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:13.721604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d6d99-fd1c-4320-aee3-0213c4d80631 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:13.731591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 736/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:15.769722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718463-ba2e-478f-9399-4de31a72ab13 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:15.770358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718463-ba2e-478f-9399-4de31a72ab13 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:15.770358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718463-ba2e-478f-9399-4de31a72ab13 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:15.771681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:15.778110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc10072-2531-4826-b647-af63c85ec3a8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:15.778835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc10072-2531-4826-b647-af63c85ec3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:15.779083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc10072-2531-4826-b647-af63c85ec3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:15.799688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6fc10072-2531-4826-b647-af63c85ec3a8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:15.801209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6fc10072-2531-4826-b647-af63c85ec3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:15.809546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:15.846420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29718463-ba2e-478f-9399-4de31a72ab13 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:15.859373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29718463-ba2e-478f-9399-4de31a72ab13 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:15.863828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f667e9-8c7e-474e-b9c5-4cb567a3b8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:15.864496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f667e9-8c7e-474e-b9c5-4cb567a3b8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:15.864780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f667e9-8c7e-474e-b9c5-4cb567a3b8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:15.865046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f667e9-8c7e-474e-b9c5-4cb567a3b8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:15.874897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f667e9-8c7e-474e-b9c5-4cb567a3b8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:15.876338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f667e9-8c7e-474e-b9c5-4cb567a3b8f3 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:15.886271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 730/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:17.922719 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171027c-972a-47e0-ac79-8eebca735242 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:17.923631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171027c-972a-47e0-ac79-8eebca735242 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:17.923631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171027c-972a-47e0-ac79-8eebca735242 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:17.925858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:17.934812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7745-ef5d-4f7e-98fd-ab3f69539c6b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:17.935237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7745-ef5d-4f7e-98fd-ab3f69539c6b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:17.935400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7745-ef5d-4f7e-98fd-ab3f69539c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:17.956867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-75fc7745-ef5d-4f7e-98fd-ab3f69539c6b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:17.958033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-75fc7745-ef5d-4f7e-98fd-ab3f69539c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:17.967060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:18.004643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171027c-972a-47e0-ac79-8eebca735242 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:18.023022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171027c-972a-47e0-ac79-8eebca735242 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:18.029552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a2f22-40c7-4f15-a17c-3e4645beb811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:18.030552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a2f22-40c7-4f15-a17c-3e4645beb811 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:18.030906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a2f22-40c7-4f15-a17c-3e4645beb811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:18.031280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a2f22-40c7-4f15-a17c-3e4645beb811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:18.042383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a2f22-40c7-4f15-a17c-3e4645beb811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:18.043810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a2f22-40c7-4f15-a17c-3e4645beb811 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:18.053330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 739/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:27.951478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=11 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:06:28.049065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=14 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:06:37.872795 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff417e59-f32c-40fe-879e-b74b5721b588 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:37.873415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff417e59-f32c-40fe-879e-b74b5721b588 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:37.873415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff417e59-f32c-40fe-879e-b74b5721b588 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:37.874856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 732/1471] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:37.883498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfceb35-20ac-4809-aedb-881b420ccfa5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:37.884034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfceb35-20ac-4809-aedb-881b420ccfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:37.884034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfceb35-20ac-4809-aedb-881b420ccfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:37.907243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5dfceb35-20ac-4809-aedb-881b420ccfa5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:37.909268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5dfceb35-20ac-4809-aedb-881b420ccfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:37.929332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 740/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:37.987865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243fb9-bfa0-4a2f-9098-68b97627e9ff None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:37.988155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243fb9-bfa0-4a2f-9098-68b97627e9ff None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:37.988432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17243fb9-bfa0-4a2f-9098-68b97627e9ff None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:37.989830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 733/1473] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jun 23 17:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:06:37.995278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53961-6bb3-48fe-b379-c06e77e09338 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:37.995561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53961-6bb3-48fe-b379-c06e77e09338 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:37.995839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53961-6bb3-48fe-b379-c06e77e09338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:38.017915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ffe53961-6bb3-48fe-b379-c06e77e09338 None None] MFA Rules not processed for user `9c211cd37d7f49eaa916d332580135c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:38.019640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ffe53961-6bb3-48fe-b379-c06e77e09338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:38.028869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 741/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jun 23 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:38.038005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17243fb9-bfa0-4a2f-9098-68b97627e9ff None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:38.051989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17243fb9-bfa0-4a2f-9098-68b97627e9ff None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:38.056398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0a037-2360-43b4-a4b9-44ff9384c0cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c211cd37d7f49eaa916d332580135c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:38.057141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a037-2360-43b4-a4b9-44ff9384c0cd service glance] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:38.057424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a037-2360-43b4-a4b9-44ff9384c0cd service glance] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:38.057700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a037-2360-43b4-a4b9-44ff9384c0cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:38.071620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a037-2360-43b4-a4b9-44ff9384c0cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:38.074235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a037-2360-43b4-a4b9-44ff9384c0cd service glance] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:38.086872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 734/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:40.342677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9337f1-8ec4-4356-bce8-4be46441eeae None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:40.343243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9337f1-8ec4-4356-bce8-4be46441eeae None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:40.343243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9337f1-8ec4-4356-bce8-4be46441eeae None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:40.344645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 742/1476] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:40.350475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f84c81-a453-46f4-94cb-2641b62f4225 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:40.350930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f84c81-a453-46f4-94cb-2641b62f4225 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:40.351065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f84c81-a453-46f4-94cb-2641b62f4225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:40.369305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-72f84c81-a453-46f4-94cb-2641b62f4225 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:40.370574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-72f84c81-a453-46f4-94cb-2641b62f4225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:40.378808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 735/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:40.402983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9337f1-8ec4-4356-bce8-4be46441eeae None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:40.419821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9337f1-8ec4-4356-bce8-4be46441eeae None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:40.424747 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6d95-d611-4f41-a7c9-27d4473f76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:40.425395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6d95-d611-4f41-a7c9-27d4473f76d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:40.425670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6d95-d611-4f41-a7c9-27d4473f76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:40.425969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6d95-d611-4f41-a7c9-27d4473f76d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:40.426710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c6d95-d611-4f41-a7c9-27d4473f76d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:40.428506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-0e9c6d95-d611-4f41-a7c9-27d4473f76d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:06:40.428506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 23 17:06:40.428506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: Jun 23 17:06:40.429674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c6d95-d611-4f41-a7c9-27d4473f76d6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:40.449191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 743/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jun 23 17:06:40 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:06:42.484866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585109c8-f1fb-400e-bbdf-03cb32ee2831 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:42.485469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585109c8-f1fb-400e-bbdf-03cb32ee2831 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:42.485469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585109c8-f1fb-400e-bbdf-03cb32ee2831 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:42.487035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 736/1479] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:42.493250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7a61-226d-446e-ae8f-fea3df5bff65 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:42.494004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7a61-226d-446e-ae8f-fea3df5bff65 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:42.494183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7a61-226d-446e-ae8f-fea3df5bff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:42.521099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d82b7a61-226d-446e-ae8f-fea3df5bff65 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:42.522348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d82b7a61-226d-446e-ae8f-fea3df5bff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:42.530483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 744/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:42.573900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585109c8-f1fb-400e-bbdf-03cb32ee2831 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:42.591079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585109c8-f1fb-400e-bbdf-03cb32ee2831 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:42.597267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40caf3-f68e-4842-b3e1-e05237f2c223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:42.597957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40caf3-f68e-4842-b3e1-e05237f2c223 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:42.598246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40caf3-f68e-4842-b3e1-e05237f2c223 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:42.598511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40caf3-f68e-4842-b3e1-e05237f2c223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:42.607423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40caf3-f68e-4842-b3e1-e05237f2c223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:42.609058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40caf3-f68e-4842-b3e1-e05237f2c223 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:42.619260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 737/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:44.825391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef75bc-ba22-44c5-a4a9-029ca1b872a4 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:44.825985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef75bc-ba22-44c5-a4a9-029ca1b872a4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:44.825985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef75bc-ba22-44c5-a4a9-029ca1b872a4 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:44.827353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 745/1482] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:44.833131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772e648-c744-4f66-8201-66a36ea34271 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:44.833580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772e648-c744-4f66-8201-66a36ea34271 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:44.833684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772e648-c744-4f66-8201-66a36ea34271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:44.854943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0772e648-c744-4f66-8201-66a36ea34271 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:44.856146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0772e648-c744-4f66-8201-66a36ea34271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:44.866655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 738/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:44.906925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef75bc-ba22-44c5-a4a9-029ca1b872a4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:44.919948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef75bc-ba22-44c5-a4a9-029ca1b872a4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:44.924030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc84dd-1af6-4762-b5bb-144563dcaa5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:44.924666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc84dd-1af6-4762-b5bb-144563dcaa5e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:44.924966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc84dd-1af6-4762-b5bb-144563dcaa5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:44.925241 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc84dd-1af6-4762-b5bb-144563dcaa5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:44.934730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc84dd-1af6-4762-b5bb-144563dcaa5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:44.936142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc84dd-1af6-4762-b5bb-144563dcaa5e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:44.946851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 746/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:47.045831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36981bc7-d3c0-4b0b-b82b-a38ee6f2c861 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:47.046428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36981bc7-d3c0-4b0b-b82b-a38ee6f2c861 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:47.046428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36981bc7-d3c0-4b0b-b82b-a38ee6f2c861 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:47.047783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 739/1485] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:47.053638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191223-66a2-47c2-8568-b2817c44de25 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:47.054122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191223-66a2-47c2-8568-b2817c44de25 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:47.054243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191223-66a2-47c2-8568-b2817c44de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:47.074555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a7191223-66a2-47c2-8568-b2817c44de25 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:47.075791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a7191223-66a2-47c2-8568-b2817c44de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:47.084913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 747/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:47.129093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36981bc7-d3c0-4b0b-b82b-a38ee6f2c861 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:47.140073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36981bc7-d3c0-4b0b-b82b-a38ee6f2c861 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:47.143676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d237ef-d344-4f0b-9240-91c87e0dd900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:47.144310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d237ef-d344-4f0b-9240-91c87e0dd900 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:47.144588 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d237ef-d344-4f0b-9240-91c87e0dd900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:47.144861 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d237ef-d344-4f0b-9240-91c87e0dd900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:47.153921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d237ef-d344-4f0b-9240-91c87e0dd900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:47.155358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d237ef-d344-4f0b-9240-91c87e0dd900 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:47.164694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 740/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:06:49.410592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096825-2a17-40e2-8c22-522fdf8d7edf None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:49.411508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096825-2a17-40e2-8c22-522fdf8d7edf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:49.411508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66096825-2a17-40e2-8c22-522fdf8d7edf None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:49.413876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 748/1488] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:06:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:06:49.419364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7809-a8ab-4a16-9d4b-736f04a22a2a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:49.419834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7809-a8ab-4a16-9d4b-736f04a22a2a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:49.419937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7809-a8ab-4a16-9d4b-736f04a22a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:49.440080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0f7a7809-a8ab-4a16-9d4b-736f04a22a2a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:49.441300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0f7a7809-a8ab-4a16-9d4b-736f04a22a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:49.450020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 741/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:49.492148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66096825-2a17-40e2-8c22-522fdf8d7edf None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:49.505569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66096825-2a17-40e2-8c22-522fdf8d7edf None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:49.509595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6044cf-4a06-4c94-9566-6366e35253c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:49.510264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6044cf-4a06-4c94-9566-6366e35253c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:49.510540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6044cf-4a06-4c94-9566-6366e35253c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:49.510809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6044cf-4a06-4c94-9566-6366e35253c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:49.520705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6044cf-4a06-4c94-9566-6366e35253c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:49.522187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6044cf-4a06-4c94-9566-6366e35253c9 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:49.532126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 749/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:06:51.804422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a66f1-6439-4747-98c4-f3eeb9617c2c None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:51.805016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a66f1-6439-4747-98c4-f3eeb9617c2c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:51.805016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a66f1-6439-4747-98c4-f3eeb9617c2c None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:51.806386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 742/1491] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jun 23 17:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:06:51.812741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2db0-1c74-4537-abc4-f3f9f55a0859 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:51.813469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2db0-1c74-4537-abc4-f3f9f55a0859 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:51.813664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2db0-1c74-4537-abc4-f3f9f55a0859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:51.833595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-251f2db0-1c74-4537-abc4-f3f9f55a0859 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:06:51.834845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-251f2db0-1c74-4537-abc4-f3f9f55a0859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:06:51.843891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 750/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jun 23 17:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:06:51.882684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a66f1-6439-4747-98c4-f3eeb9617c2c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:06:51.896720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a66f1-6439-4747-98c4-f3eeb9617c2c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:06:51.901573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef0536-6fde-4c2f-b773-bb6294e775ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:06:51.902260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0536-6fde-4c2f-b773-bb6294e775ef service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:06:51.902537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0536-6fde-4c2f-b773-bb6294e775ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:06:51.902811 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0536-6fde-4c2f-b773-bb6294e775ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:06:51.914551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef0536-6fde-4c2f-b773-bb6294e775ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:06:51.915999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef0536-6fde-4c2f-b773-bb6294e775ef service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:06:51.926322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 743/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:07:01.827953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=33 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:07:01.921327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=33 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:08:17.075993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a310f-fb21-46d6-8b67-01eecd6a295a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.076893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a310f-fb21-46d6-8b67-01eecd6a295a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.076893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a310f-fb21-46d6-8b67-01eecd6a295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.102020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f90a310f-fb21-46d6-8b67-01eecd6a295a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:08:17.103242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f90a310f-fb21-46d6-8b67-01eecd6a295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:08:17.111875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 751/1494] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:08:17.121779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96d3a-466b-4311-9861-e137e57f6af4 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.122352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96d3a-466b-4311-9861-e137e57f6af4 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.122553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96d3a-466b-4311-9861-e137e57f6af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.142133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-61d96d3a-466b-4311-9861-e137e57f6af4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:08:17.143355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-61d96d3a-466b-4311-9861-e137e57f6af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:08:17.152357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 744/1495] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:08:17.157535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a310f-fb21-46d6-8b67-01eecd6a295a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:17.167528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a310f-fb21-46d6-8b67-01eecd6a295a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:17.172446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:17.173094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.173375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.173650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.174404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:08:17.174694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:17.175715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:08:17.175715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 23 17:08:17.175715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: Jun 23 17:08:17.176587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:17.188660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 752/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:08:17.196976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96d3a-466b-4311-9861-e137e57f6af4 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:17.206678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96d3a-466b-4311-9861-e137e57f6af4 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:17.211771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:17.212454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.212740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.213004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.213698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:17.215565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING py.warnings [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:08:17.215565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: warnings.warn(msg) Jun 23 17:08:17.215565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: Jun 23 17:08:17.216750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:17.256965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 745/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:08:17 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:08:17.261268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:17.272198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd46f-c2e6-4d06-a4fa-141918ea430a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:17.332803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:17.333415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.333692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.333999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.334686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:17.335712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:08:17.335712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 23 17:08:17.335712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: Jun 23 17:08:17.336918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:17.358956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 753/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:08:17 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:08:17.365535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:17.380226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fe29-bdca-4c87-9988-839271523c9e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:17.385880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54768823-79e0-4938-95e1-794745539836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:17.386557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54768823-79e0-4938-95e1-794745539836 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.386839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54768823-79e0-4938-95e1-794745539836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.387142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54768823-79e0-4938-95e1-794745539836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.387866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54768823-79e0-4938-95e1-794745539836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:17.388898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING py.warnings [None req-54768823-79e0-4938-95e1-794745539836 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:08:17.388898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: warnings.warn(msg) Jun 23 17:08:17.388898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: Jun 23 17:08:17.389782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54768823-79e0-4938-95e1-794745539836 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:17.403354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 746/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:08:17.408784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:17.424242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75290ab-3751-4f22-8f39-8a4fb6394739 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:17.430007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168fc68-23d8-4b85-b9d6-6cefbfe92fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:17.430659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168fc68-23d8-4b85-b9d6-6cefbfe92fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.430942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168fc68-23d8-4b85-b9d6-6cefbfe92fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.431214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168fc68-23d8-4b85-b9d6-6cefbfe92fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.431944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168fc68-23d8-4b85-b9d6-6cefbfe92fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:17.432997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-f168fc68-23d8-4b85-b9d6-6cefbfe92fb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:08:17.432997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 23 17:08:17.432997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: Jun 23 17:08:17.433927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168fc68-23d8-4b85-b9d6-6cefbfe92fb6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:17.447958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 754/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:08:17.452266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54768823-79e0-4938-95e1-794745539836 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:17.463116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54768823-79e0-4938-95e1-794745539836 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:17.467991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd03dd-3aa8-4597-be94-358c13e1fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:17.469209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd03dd-3aa8-4597-be94-358c13e1fdba admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.469490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd03dd-3aa8-4597-be94-358c13e1fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.469767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd03dd-3aa8-4597-be94-358c13e1fdba admin admin] PATH_INFO: `/v3/projects/4cb225e88d314330a846843ec511a831/users/6971aad1526d4de89f18aa8f24c1dcb3/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.484642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd03dd-3aa8-4597-be94-358c13e1fdba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb225e88d314330a846843ec511a831, user_id=6971aad1526d4de89f18aa8f24c1dcb3, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:17.485676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING py.warnings [None req-d1dd03dd-3aa8-4597-be94-358c13e1fdba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:08:17.485676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: warnings.warn(msg) Jun 23 17:08:17.485676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: Jun 23 17:08:17.487653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd03dd-3aa8-4597-be94-358c13e1fdba admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:17.503646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 747/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:08:17 2022] PUT /identity/v3/projects/4cb225e88d314330a846843ec511a831/users/6971aad1526d4de89f18aa8f24c1dcb3/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:08:17.514997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7da7-576a-4fd5-b6db-2e9d1623f772 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.515523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7da7-576a-4fd5-b6db-2e9d1623f772 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.515811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb7da7-576a-4fd5-b6db-2e9d1623f772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.542988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-20eb7da7-576a-4fd5-b6db-2e9d1623f772 None None] MFA Rules not processed for user `6971aad1526d4de89f18aa8f24c1dcb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:08:17.544197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-20eb7da7-576a-4fd5-b6db-2e9d1623f772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:08:17.612715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 755/1502] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:08:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:08:17.626338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c44e-6b37-425d-a0ef-2e225a7f894d None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.626631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c44e-6b37-425d-a0ef-2e225a7f894d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.626911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c44e-6b37-425d-a0ef-2e225a7f894d None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.628354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 748/1503] 10.222.0.18 () {54 vars in 963 bytes} [Thu Jun 23 17:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:08:17.633379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4b19-d6f0-444c-8e14-71b70ef40e06 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.633707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4b19-d6f0-444c-8e14-71b70ef40e06 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.634005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4b19-d6f0-444c-8e14-71b70ef40e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.653632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fffb4b19-d6f0-444c-8e14-71b70ef40e06 None None] MFA Rules not processed for user `3c8b0c3534b84db68461b426a3f78773`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:08:17.654885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fffb4b19-d6f0-444c-8e14-71b70ef40e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:08:17.704881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:08:17.714064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 756/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Thu Jun 23 17:08:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:08:17.721983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c44e-6b37-425d-a0ef-2e225a7f894d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:17.733593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c44e-6b37-425d-a0ef-2e225a7f894d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:17.737505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64af6c-65d9-4929-8bea-69f479e4780c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:17.738184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64af6c-65d9-4929-8bea-69f479e4780c service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.738460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64af6c-65d9-4929-8bea-69f479e4780c service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.738735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64af6c-65d9-4929-8bea-69f479e4780c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.747215 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64af6c-65d9-4929-8bea-69f479e4780c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:17.748660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64af6c-65d9-4929-8bea-69f479e4780c service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:17.758343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 749/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:08:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:08:17.800204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256ea2-c2a5-4fbb-a2fb-b67571bda9e4 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.800488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256ea2-c2a5-4fbb-a2fb-b67571bda9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.800766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256ea2-c2a5-4fbb-a2fb-b67571bda9e4 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.802071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 757/1506] 10.222.0.18 () {52 vars in 829 bytes} [Thu Jun 23 17:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:08:17.806119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64af6c-65d9-4929-8bea-69f479e4780c service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:17.880722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64af6c-65d9-4929-8bea-69f479e4780c service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:17.885669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:17.886580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:17.886862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:17.887138 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] PATH_INFO: `/v3/users/6971aad1526d4de89f18aa8f24c1dcb3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:17.888414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6971aad1526d4de89f18aa8f24c1dcb3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:17.889451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING py.warnings [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:08:17.889451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: warnings.warn(msg) Jun 23 17:08:17.889451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: Jun 23 17:08:17.890701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:17.965492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6971aad1526d4de89f18aa8f24c1dcb3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:17.977291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6971aad1526d4de89f18aa8f24c1dcb3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:17.997147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6971aad1526d4de89f18aa8f24c1dcb3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:18.007194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:08:18.012671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6971aad1526d4de89f18aa8f24c1dcb3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:18.013438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6971aad1526d4de89f18aa8f24c1dcb3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:18.021467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 750/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:08:17 2022] DELETE /identity/v3/users/6971aad1526d4de89f18aa8f24c1dcb3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:08:18.026042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345639-99c4-4d2b-8112-5382e816446c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:18.026417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345639-99c4-4d2b-8112-5382e816446c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:18.026697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345639-99c4-4d2b-8112-5382e816446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:18.045364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d5345639-99c4-4d2b-8112-5382e816446c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:08:18.046639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d5345639-99c4-4d2b-8112-5382e816446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:08:18.106742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 758/1508] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:08:18.117302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:18.118961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:08:18.178149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26817c-a0d9-4a15-9ad0-2fe385e6ebc6 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:18.182451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efc12f-1b18-4b6c-94fb-50b2e220bcc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:18.183136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efc12f-1b18-4b6c-94fb-50b2e220bcc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:18.183418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efc12f-1b18-4b6c-94fb-50b2e220bcc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:18.183696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efc12f-1b18-4b6c-94fb-50b2e220bcc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:18.194781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efc12f-1b18-4b6c-94fb-50b2e220bcc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:18.196234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efc12f-1b18-4b6c-94fb-50b2e220bcc7 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:18.206332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 751/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:08:18.611222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5345639-99c4-4d2b-8112-5382e816446c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:08:18.612748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d5345639-99c4-4d2b-8112-5382e816446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:08:18.624599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5345639-99c4-4d2b-8112-5382e816446c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:08:18.630173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:08:18.630707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:08:18.631019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:08:18.631286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] PATH_INFO: `/v3/projects/4cb225e88d314330a846843ec511a831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:08:18.632586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb225e88d314330a846843ec511a831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:08:18.633608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:08:18.633608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 23 17:08:18.633608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: Jun 23 17:08:18.635008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:08:18.697427 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb225e88d314330a846843ec511a831', 'request_id': 'req-b52795d4-198e-4603-9f1e-bd9ad50cabcb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:18.703577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb225e88d314330a846843ec511a831', 'request_id': 'req-b52795d4-198e-4603-9f1e-bd9ad50cabcb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:18.716844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb225e88d314330a846843ec511a831', 'request_id': 'req-b52795d4-198e-4603-9f1e-bd9ad50cabcb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:18.732900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] The token cache is being invalidate because project 4cb225e88d314330a846843ec511a831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:08:18.733187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:18.734066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b52795d4-198e-4603-9f1e-bd9ad50cabcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:08:18.735760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 759/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:08:18 2022] DELETE /identity/v3/projects/4cb225e88d314330a846843ec511a831 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:08:28.201745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=29 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:08:28.729904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:09:55.173322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184191-6212-49ed-bfa0-497e579a0d6a None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:09:55.173977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184191-6212-49ed-bfa0-497e579a0d6a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:09:55.173977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80184191-6212-49ed-bfa0-497e579a0d6a None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:09:55.175310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:09:55.180397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2b1bb-e843-485b-a4d1-d29863db0a01 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:09:55.180857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2b1bb-e843-485b-a4d1-d29863db0a01 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:09:55.180953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2b1bb-e843-485b-a4d1-d29863db0a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:09:55.200151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-05d2b1bb-e843-485b-a4d1-d29863db0a01 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:09:55.201380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-05d2b1bb-e843-485b-a4d1-d29863db0a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:09:55.268682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:09:55.422890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80184191-6212-49ed-bfa0-497e579a0d6a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:09:55.426083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-80184191-6212-49ed-bfa0-497e579a0d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:09:55.516464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80184191-6212-49ed-bfa0-497e579a0d6a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:09:55.523299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4771d5-ed34-4da9-ab11-73543de2b521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:09:55.523894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4771d5-ed34-4da9-ab11-73543de2b521 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:09:55.524175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4771d5-ed34-4da9-ab11-73543de2b521 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:09:55.524455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4771d5-ed34-4da9-ab11-73543de2b521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:09:55.533224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4771d5-ed34-4da9-ab11-73543de2b521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:09:55.534889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4771d5-ed34-4da9-ab11-73543de2b521 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:09:55.544751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 753/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:09:56.376823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2cfed-8beb-4a9d-a69d-663100cfd30f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:09:56.377428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2cfed-8beb-4a9d-a69d-663100cfd30f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:09:56.377428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2cfed-8beb-4a9d-a69d-663100cfd30f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:09:56.379658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:09:56.387452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a554-86b2-44cc-bbc4-cb34b82273fc None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:09:56.387833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a554-86b2-44cc-bbc4-cb34b82273fc None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:09:56.388040 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a554-86b2-44cc-bbc4-cb34b82273fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:09:56.537339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9d62a554-86b2-44cc-bbc4-cb34b82273fc None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:09:56.538626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9d62a554-86b2-44cc-bbc4-cb34b82273fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:09:56.551516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:09:56.717070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2cfed-8beb-4a9d-a69d-663100cfd30f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:09:56.742079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2cfed-8beb-4a9d-a69d-663100cfd30f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:09:56.749424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0ea32-30aa-4252-bb5f-4b441c3b4bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:09:56.750103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0ea32-30aa-4252-bb5f-4b441c3b4bf4 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:09:56.750386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0ea32-30aa-4252-bb5f-4b441c3b4bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:09:56.750662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0ea32-30aa-4252-bb5f-4b441c3b4bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:09:56.759593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0ea32-30aa-4252-bb5f-4b441c3b4bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:09:56.761724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0ea32-30aa-4252-bb5f-4b441c3b4bf4 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:09:56.771579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 762/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:09:57.668551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131f8aa-6f49-4a92-8c89-8b114781eae0 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:09:57.669350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131f8aa-6f49-4a92-8c89-8b114781eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:09:57.669350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131f8aa-6f49-4a92-8c89-8b114781eae0 None None] PATH_INFO: `/v3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:09:57.671018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 755/1517] 10.222.0.57 () {54 vars in 925 bytes} [Thu Jun 23 17:09:57 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:09:57.687832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c241e40-fbe3-4c6e-ab40-b4a8c66131f4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:09:57.688940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c241e40-fbe3-4c6e-ab40-b4a8c66131f4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:09:57.689568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c241e40-fbe3-4c6e-ab40-b4a8c66131f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:09:57.712821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8c241e40-fbe3-4c6e-ab40-b4a8c66131f4 None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:09:57.714738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8c241e40-fbe3-4c6e-ab40-b4a8c66131f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:09:57.783197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 763/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jun 23 17:09:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:10:06.403268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=37 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:10:07.774111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=62 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:10:08.002219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641a54b-2a7e-497f-8fa6-639f82f12471 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:08.002765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641a54b-2a7e-497f-8fa6-639f82f12471 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:08.002765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641a54b-2a7e-497f-8fa6-639f82f12471 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:08.004056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 756/1519] 10.222.0.18 () {54 vars in 960 bytes} [Thu Jun 23 17:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:10:08.009140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b5f6f-538d-4729-85d6-4987548137ad None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:08.009498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b5f6f-538d-4729-85d6-4987548137ad None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:08.009838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b5f6f-538d-4729-85d6-4987548137ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:08.027157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7aac-9a22-4a41-b8fc-7160407b1757 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:08.027591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7aac-9a22-4a41-b8fc-7160407b1757 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:08.028157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7aac-9a22-4a41-b8fc-7160407b1757 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:08.029496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 757/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:10:08.030757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a62b5f6f-538d-4729-85d6-4987548137ad None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:10:08.031973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a62b5f6f-538d-4729-85d6-4987548137ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:08.034171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba654b-6609-4a99-926b-145be0a22e4f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:08.034456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba654b-6609-4a99-926b-145be0a22e4f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:08.034734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba654b-6609-4a99-926b-145be0a22e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:08.041641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 764/1521] 10.222.0.18 () {58 vars in 1057 bytes} [Thu Jun 23 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:10:08.049417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b5f6f-538d-4729-85d6-4987548137ad None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:10:08.053417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-8bba654b-6609-4a99-926b-145be0a22e4f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:10:08.054670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8bba654b-6609-4a99-926b-145be0a22e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:08.059016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b5f6f-538d-4729-85d6-4987548137ad None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:10:08.064179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 758/1522] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:10:08.064599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf95ea6-d4cb-4013-a94f-c12ca6938ee3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:10:08.065313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95ea6-d4cb-4013-a94f-c12ca6938ee3 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:08.065597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95ea6-d4cb-4013-a94f-c12ca6938ee3 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:08.065897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf95ea6-d4cb-4013-a94f-c12ca6938ee3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:08.075242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf95ea6-d4cb-4013-a94f-c12ca6938ee3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:10:08.076876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf95ea6-d4cb-4013-a94f-c12ca6938ee3 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:10:08.086932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 765/1523] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:10:08.216248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba654b-6609-4a99-926b-145be0a22e4f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:10:08.233766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba654b-6609-4a99-926b-145be0a22e4f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:10:08.240806 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26698f-55f4-49b4-ae7d-03e29a1256e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:10:08.241459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26698f-55f4-49b4-ae7d-03e29a1256e8 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:08.241743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26698f-55f4-49b4-ae7d-03e29a1256e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:08.242050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26698f-55f4-49b4-ae7d-03e29a1256e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:08.251015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26698f-55f4-49b4-ae7d-03e29a1256e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:10:08.252662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26698f-55f4-49b4-ae7d-03e29a1256e8 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:10:08.262156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 759/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:10:09.081785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917eb0-23a4-4eed-96c1-e7dc109a924e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:09.082735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917eb0-23a4-4eed-96c1-e7dc109a924e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:09.082735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917eb0-23a4-4eed-96c1-e7dc109a924e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:09.085008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 17:10:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:10:09.093309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c29f5f-0968-4a0e-95f9-1d9afc3d72aa None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:09.093752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c29f5f-0968-4a0e-95f9-1d9afc3d72aa None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:09.093887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c29f5f-0968-4a0e-95f9-1d9afc3d72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:09.117975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-75c29f5f-0968-4a0e-95f9-1d9afc3d72aa None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:10:09.119196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-75c29f5f-0968-4a0e-95f9-1d9afc3d72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:09.128783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 17:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:10:09.296331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917eb0-23a4-4eed-96c1-e7dc109a924e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:10:09.317829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917eb0-23a4-4eed-96c1-e7dc109a924e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:10:09.323868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07446a31-a133-45b8-aa1c-0081b0f84d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:10:09.324514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07446a31-a133-45b8-aa1c-0081b0f84d2e service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:09.324795 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07446a31-a133-45b8-aa1c-0081b0f84d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:09.325071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07446a31-a133-45b8-aa1c-0081b0f84d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:09.333367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07446a31-a133-45b8-aa1c-0081b0f84d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:10:09.334993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07446a31-a133-45b8-aa1c-0081b0f84d2e service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:10:09.344710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 767/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:10:13.381286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f729-4c70-4a61-9e12-0d552638f594 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:13.382008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f729-4c70-4a61-9e12-0d552638f594 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:13.382008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f729-4c70-4a61-9e12-0d552638f594 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:13.383248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:10:13.388967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c404908-1b90-4fc5-8c2f-74163b840bfb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:13.389473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c404908-1b90-4fc5-8c2f-74163b840bfb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:13.389473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c404908-1b90-4fc5-8c2f-74163b840bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:13.408739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2c404908-1b90-4fc5-8c2f-74163b840bfb None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:10:13.409956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2c404908-1b90-4fc5-8c2f-74163b840bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:13.418590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:10:13.459479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16f729-4c70-4a61-9e12-0d552638f594 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:10:13.462751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bf16f729-4c70-4a61-9e12-0d552638f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:13.527105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16f729-4c70-4a61-9e12-0d552638f594 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:10:13.531500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e6221-7b37-4434-9e0f-aa60d72447d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:10:13.532156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e6221-7b37-4434-9e0f-aa60d72447d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:13.532437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e6221-7b37-4434-9e0f-aa60d72447d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:13.532708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e6221-7b37-4434-9e0f-aa60d72447d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:13.542445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e6221-7b37-4434-9e0f-aa60d72447d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:10:13.543884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e6221-7b37-4434-9e0f-aa60d72447d7 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:10:13.553758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 762/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:10:15.582198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672ca3-a5c7-494e-8e6e-597521b5452d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:15.582810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672ca3-a5c7-494e-8e6e-597521b5452d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:15.582810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672ca3-a5c7-494e-8e6e-597521b5452d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:15.584144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:10:15.589580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df1af-9ed1-4588-9baf-0cca8ee57151 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:15.590064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df1af-9ed1-4588-9baf-0cca8ee57151 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:15.590170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5df1af-9ed1-4588-9baf-0cca8ee57151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:15.611530 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1a5df1af-9ed1-4588-9baf-0cca8ee57151 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:10:15.613346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1a5df1af-9ed1-4588-9baf-0cca8ee57151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:15.626079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:10:15.666810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672ca3-a5c7-494e-8e6e-597521b5452d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:10:15.685359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672ca3-a5c7-494e-8e6e-597521b5452d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:10:15.689821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486928f-651a-4ccf-a437-69ea06deb6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:10:15.690509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486928f-651a-4ccf-a437-69ea06deb6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:15.690868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486928f-651a-4ccf-a437-69ea06deb6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:15.691102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486928f-651a-4ccf-a437-69ea06deb6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:15.706550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486928f-651a-4ccf-a437-69ea06deb6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:10:15.708696 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486928f-651a-4ccf-a437-69ea06deb6b4 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:10:15.720789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 770/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:10:19.354883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3951ca-9195-4f99-ba08-8288df6ecc02 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:19.355844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3951ca-9195-4f99-ba08-8288df6ecc02 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:19.355844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3951ca-9195-4f99-ba08-8288df6ecc02 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:19.357937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:10:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:10:19.363376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda75f3-4841-4a21-835c-5b3e9f3cf86a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:19.363849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda75f3-4841-4a21-835c-5b3e9f3cf86a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:19.363951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda75f3-4841-4a21-835c-5b3e9f3cf86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:19.383155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ebda75f3-4841-4a21-835c-5b3e9f3cf86a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:10:19.384354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ebda75f3-4841-4a21-835c-5b3e9f3cf86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:19.392821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:10:19.697281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3951ca-9195-4f99-ba08-8288df6ecc02 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:10:19.700134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bc3951ca-9195-4f99-ba08-8288df6ecc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:19.769274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3951ca-9195-4f99-ba08-8288df6ecc02 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:10:19.773317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e6f6-a5ba-4314-abde-3469c9156419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:10:19.774008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e6f6-a5ba-4314-abde-3469c9156419 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:19.774282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e6f6-a5ba-4314-abde-3469c9156419 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:19.774559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e6f6-a5ba-4314-abde-3469c9156419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:19.784189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e6f6-a5ba-4314-abde-3469c9156419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:10:19.785635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e6f6-a5ba-4314-abde-3469c9156419 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:10:19.795242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 765/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:10:21.836168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ff8d5-a1f3-4000-a10b-654727513706 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:21.837090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ff8d5-a1f3-4000-a10b-654727513706 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:21.837090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ff8d5-a1f3-4000-a10b-654727513706 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:21.839377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 17:10:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:10:21.845839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f4a09-dac8-4480-ae5c-bb0300bc10c2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:21.846292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f4a09-dac8-4480-ae5c-bb0300bc10c2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:21.846388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f4a09-dac8-4480-ae5c-bb0300bc10c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:21.874486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-8e4f4a09-dac8-4480-ae5c-bb0300bc10c2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:10:21.875731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8e4f4a09-dac8-4480-ae5c-bb0300bc10c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:21.885101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 17:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:10:22.186761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ff8d5-a1f3-4000-a10b-654727513706 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:10:22.188850 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3f6ff8d5-a1f3-4000-a10b-654727513706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:10:22.204029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ff8d5-a1f3-4000-a10b-654727513706 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:10:22.207873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3826a2-a943-4c46-b138-cdae80313dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:10:22.208504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3826a2-a943-4c46-b138-cdae80313dee service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:10:22.208781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3826a2-a943-4c46-b138-cdae80313dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:10:22.209055 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3826a2-a943-4c46-b138-cdae80313dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:10:22.218339 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3826a2-a943-4c46-b138-cdae80313dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:10:22.219748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3826a2-a943-4c46-b138-cdae80313dee service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:10:22.229091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 773/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:10:31.868802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=70 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:10:32.225203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=33 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:50.870751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedf14c-1806-4390-8801-15e36d603e05 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:50.874265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedf14c-1806-4390-8801-15e36d603e05 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:50.874265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedf14c-1806-4390-8801-15e36d603e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:50.889516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc27f3-3b1d-4487-a2aa-0d1a50dbe56f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:50.890688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc27f3-3b1d-4487-a2aa-0d1a50dbe56f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:50.891198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc27f3-3b1d-4487-a2aa-0d1a50dbe56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:50.898785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-fcedf14c-1806-4390-8801-15e36d603e05 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:50.899993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fcedf14c-1806-4390-8801-15e36d603e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:50.917448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 767/1540] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:11:50.918260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b2cc27f3-3b1d-4487-a2aa-0d1a50dbe56f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:50.919492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b2cc27f3-3b1d-4487-a2aa-0d1a50dbe56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:50.930256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8455e-a833-4d1a-8f54-ad5333a0dd1f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:50.930574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8455e-a833-4d1a-8f54-ad5333a0dd1f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:50.930937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8455e-a833-4d1a-8f54-ad5333a0dd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:50.932786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 774/1541] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:11:50.938179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165810a-9821-404e-98fa-b9ebf0da2134 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:50.938448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165810a-9821-404e-98fa-b9ebf0da2134 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:50.938660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165810a-9821-404e-98fa-b9ebf0da2134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:50.967279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-70d8455e-a833-4d1a-8f54-ad5333a0dd1f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:50.968430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a165810a-9821-404e-98fa-b9ebf0da2134 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:50.968660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-70d8455e-a833-4d1a-8f54-ad5333a0dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:50.969609 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a165810a-9821-404e-98fa-b9ebf0da2134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:50.985763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 775/1542] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:11:50.987066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698541-e398-4c69-a670-74546c469c5f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:50.987377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698541-e398-4c69-a670-74546c469c5f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:50.987624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698541-e398-4c69-a670-74546c469c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:50.990514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 768/1543] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:11:50.996869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8455e-a833-4d1a-8f54-ad5333a0dd1f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.019078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-05698541-e398-4c69-a670-74546c469c5f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.021665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8455e-a833-4d1a-8f54-ad5333a0dd1f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.023398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-05698541-e398-4c69-a670-74546c469c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.036505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ca201-92b0-4a96-9553-302fb1b576d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.037869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca201-92b0-4a96-9553-302fb1b576d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.038154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca201-92b0-4a96-9553-302fb1b576d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.038429 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca201-92b0-4a96-9553-302fb1b576d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.039168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca201-92b0-4a96-9553-302fb1b576d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:11:51.039471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca201-92b0-4a96-9553-302fb1b576d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.040503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING py.warnings [None req-5b5ca201-92b0-4a96-9553-302fb1b576d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:11:51.040503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: warnings.warn(msg) Jun 23 17:11:51.040503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: Jun 23 17:11:51.041382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca201-92b0-4a96-9553-302fb1b576d6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.058971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 776/1544] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.058971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cb341-1529-4b02-9acd-1f329bff356b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.058971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cb341-1529-4b02-9acd-1f329bff356b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.058971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cb341-1529-4b02-9acd-1f329bff356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.072246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 769/1545] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:11:51.074109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f57cc-efe3-4384-8a77-4b69a6f6584d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.074608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f57cc-efe3-4384-8a77-4b69a6f6584d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.075066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f57cc-efe3-4384-8a77-4b69a6f6584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.090371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-593cb341-1529-4b02-9acd-1f329bff356b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.091750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-593cb341-1529-4b02-9acd-1f329bff356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.094386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-be9f57cc-efe3-4384-8a77-4b69a6f6584d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.095547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-be9f57cc-efe3-4384-8a77-4b69a6f6584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.100347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 777/1546] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.101702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8203-4c7c-43e1-a9b6-b4c2218c10c4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.102027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8203-4c7c-43e1-a9b6-b4c2218c10c4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.102304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8203-4c7c-43e1-a9b6-b4c2218c10c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.105830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 770/1547] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.105830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790177d-9a2c-401a-bb75-52f09d0f820d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.106076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790177d-9a2c-401a-bb75-52f09d0f820d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.106173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790177d-9a2c-401a-bb75-52f09d0f820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.123008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6fdc8203-4c7c-43e1-a9b6-b4c2218c10c4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.124147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0790177d-9a2c-401a-bb75-52f09d0f820d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.124389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6fdc8203-4c7c-43e1-a9b6-b4c2218c10c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.125300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0790177d-9a2c-401a-bb75-52f09d0f820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.133829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 778/1548] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.133829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc8203-4c7c-43e1-a9b6-b4c2218c10c4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.134051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 771/1549] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.135145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbac22-82b5-4da2-93b0-cfae35a56706 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.135426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbac22-82b5-4da2-93b0-cfae35a56706 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.135698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbac22-82b5-4da2-93b0-cfae35a56706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.152243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc8203-4c7c-43e1-a9b6-b4c2218c10c4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.156931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8500b-ab3b-4147-a39e-cb9eb27fe249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.157595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8500b-ab3b-4147-a39e-cb9eb27fe249 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.157905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8500b-ab3b-4147-a39e-cb9eb27fe249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.158182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8500b-ab3b-4147-a39e-cb9eb27fe249 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.158661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2ecbac22-82b5-4da2-93b0-cfae35a56706 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.159055 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8500b-ab3b-4147-a39e-cb9eb27fe249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:11:51.159358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8500b-ab3b-4147-a39e-cb9eb27fe249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.160134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2ecbac22-82b5-4da2-93b0-cfae35a56706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.161145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8500b-ab3b-4147-a39e-cb9eb27fe249 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.167991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 772/1550] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.168734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbac22-82b5-4da2-93b0-cfae35a56706 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.177992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 779/1551] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:11:51.177992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88558-5f4d-4981-a6b4-3865a702b633 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.177992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88558-5f4d-4981-a6b4-3865a702b633 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.177992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88558-5f4d-4981-a6b4-3865a702b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.178983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbac22-82b5-4da2-93b0-cfae35a56706 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.183558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4626-cc1f-46e2-a8f9-5d918928c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.184212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4626-cc1f-46e2-a8f9-5d918928c1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.184497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4626-cc1f-46e2-a8f9-5d918928c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.184766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4626-cc1f-46e2-a8f9-5d918928c1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.185449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b4626-cc1f-46e2-a8f9-5d918928c1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.187368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b4626-cc1f-46e2-a8f9-5d918928c1ec admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.195975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-30d88558-5f4d-4981-a6b4-3865a702b633 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.197549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-30d88558-5f4d-4981-a6b4-3865a702b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.206993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 780/1552] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.208067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88558-5f4d-4981-a6b4-3865a702b633 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.216530 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 773/1553] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.218011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88558-5f4d-4981-a6b4-3865a702b633 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.218181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4d98-ed65-45a2-adf1-edbcd87c6aea None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.218491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4d98-ed65-45a2-adf1-edbcd87c6aea None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.218746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe4d98-ed65-45a2-adf1-edbcd87c6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.238812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-19fe4d98-ed65-45a2-adf1-edbcd87c6aea None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.240015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-19fe4d98-ed65-45a2-adf1-edbcd87c6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.274387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5bbbf-3294-4eb7-83f9-bf67bf65dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.275049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5bbbf-3294-4eb7-83f9-bf67bf65dfba admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.275334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5bbbf-3294-4eb7-83f9-bf67bf65dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.275602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5bbbf-3294-4eb7-83f9-bf67bf65dfba admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.276323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5bbbf-3294-4eb7-83f9-bf67bf65dfba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:11:51.276628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5bbbf-3294-4eb7-83f9-bf67bf65dfba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.278292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5bbbf-3294-4eb7-83f9-bf67bf65dfba admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.290420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 781/1554] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:11:51.291784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38d4bc-faa2-4dca-9f25-416eebeeb42f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.292076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38d4bc-faa2-4dca-9f25-416eebeeb42f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.292355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38d4bc-faa2-4dca-9f25-416eebeeb42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.306147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 774/1555] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.310216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2b38d4bc-faa2-4dca-9f25-416eebeeb42f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.310972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2989ed-49a8-43bc-a11d-fd39de2dde2f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.311258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2989ed-49a8-43bc-a11d-fd39de2dde2f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.311436 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2b38d4bc-faa2-4dca-9f25-416eebeeb42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.311533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2989ed-49a8-43bc-a11d-fd39de2dde2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.319997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 782/1556] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.321221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d489e-079e-4258-b08a-19c7f677d7c7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.321508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d489e-079e-4258-b08a-19c7f677d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.321786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d489e-079e-4258-b08a-19c7f677d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.329662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-ef2989ed-49a8-43bc-a11d-fd39de2dde2f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.330916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ef2989ed-49a8-43bc-a11d-fd39de2dde2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.338814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 775/1557] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.339397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2989ed-49a8-43bc-a11d-fd39de2dde2f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.339879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-884d489e-079e-4258-b08a-19c7f677d7c7 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.341047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-884d489e-079e-4258-b08a-19c7f677d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.348799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2989ed-49a8-43bc-a11d-fd39de2dde2f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.349137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 783/1558] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.350443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28146-9d98-4499-9d73-8c3060f43d89 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.350731 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28146-9d98-4499-9d73-8c3060f43d89 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.351005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28146-9d98-4499-9d73-8c3060f43d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.355464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2f654-eb6b-4abb-bc73-2d80abf87174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.356113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2f654-eb6b-4abb-bc73-2d80abf87174 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.356386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2f654-eb6b-4abb-bc73-2d80abf87174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.356656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2f654-eb6b-4abb-bc73-2d80abf87174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.357339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2f654-eb6b-4abb-bc73-2d80abf87174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.359259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2f654-eb6b-4abb-bc73-2d80abf87174 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.368671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3bc28146-9d98-4499-9d73-8c3060f43d89 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:51.369899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3bc28146-9d98-4499-9d73-8c3060f43d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:51.378828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 784/1559] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:51.379589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc28146-9d98-4499-9d73-8c3060f43d89 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.386196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 776/1560] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.386872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2f654-eb6b-4abb-bc73-2d80abf87174 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.391479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc28146-9d98-4499-9d73-8c3060f43d89 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.447349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba16db-faef-43ef-bc47-82b571c84d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.447937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba16db-faef-43ef-bc47-82b571c84d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.448218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba16db-faef-43ef-bc47-82b571c84d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.448495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba16db-faef-43ef-bc47-82b571c84d8c admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.449193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba16db-faef-43ef-bc47-82b571c84d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.450843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2f654-eb6b-4abb-bc73-2d80abf87174 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.451166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba16db-faef-43ef-bc47-82b571c84d8c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.455365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd2ab-8418-4fe3-b092-191d59e45755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.456102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd2ab-8418-4fe3-b092-191d59e45755 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.456381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd2ab-8418-4fe3-b092-191d59e45755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.456651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd2ab-8418-4fe3-b092-191d59e45755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.457361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd2ab-8418-4fe3-b092-191d59e45755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.459449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd2ab-8418-4fe3-b092-191d59e45755 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.468260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:51.476018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 785/1561] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.477403 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba16db-faef-43ef-bc47-82b571c84d8c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.488275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba16db-faef-43ef-bc47-82b571c84d8c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.490869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 777/1562] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.491695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd2ab-8418-4fe3-b092-191d59e45755 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.496288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.497105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.497388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.497665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.498437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:11:51.498750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.500364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.507574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:51.514355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 786/1563] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:11:51.516805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.536122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca917d7f-accc-4fcd-b689-aae2a9e269a4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.557991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd2ab-8418-4fe3-b092-191d59e45755 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.562517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.563190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.563486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.563745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.564472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:11:51.565152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.566872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.578254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 778/1564] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:11:51.579058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.591025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ad51-72a0-4ace-a5e4-641c7de5d6af admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.592015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.592673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.592950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.593222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.593990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:11:51.594294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.595884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.595987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.596716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.597076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.597289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.598042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:11:51.598345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.599929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.607483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 787/1565] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:11:51.608272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.616176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 779/1566] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:11:51.616829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.624127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba5b4-4e29-4dad-85b7-3862d005e028 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.628940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.629594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.629706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa602170-3a6a-4238-aad9-341ae47fbc57 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.629898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.630169 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.630887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:11:51.631176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.632879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.634545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.635555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.635555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.635767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.636402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.637402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING py.warnings [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:11:51.637402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: warnings.warn(msg) Jun 23 17:11:51.637402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: Jun 23 17:11:51.638609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.645037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 788/1567] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:11:51.645862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.655783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404ac2f-7a44-4b9d-960b-a7500c081a4c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.661343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a0cab-2880-4e98-b030-4377f367b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.662192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a0cab-2880-4e98-b030-4377f367b5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.662571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a0cab-2880-4e98-b030-4377f367b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.662975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a0cab-2880-4e98-b030-4377f367b5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.663711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a0cab-2880-4e98-b030-4377f367b5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.665157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 780/1568] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.666109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.668453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a0cab-2880-4e98-b030-4377f367b5ac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.675446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82673a59-2fe3-421d-89b2-c2db936720be admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.682144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 789/1569] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:51.682144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a0cab-2880-4e98-b030-4377f367b5ac admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.682392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d40fad-48d4-4521-ade1-2ab0bb24475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.682392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d40fad-48d4-4521-ade1-2ab0bb24475e admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.682392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d40fad-48d4-4521-ade1-2ab0bb24475e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.682392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d40fad-48d4-4521-ade1-2ab0bb24475e admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.683074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d40fad-48d4-4521-ade1-2ab0bb24475e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.685182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d40fad-48d4-4521-ade1-2ab0bb24475e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.690423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a0cab-2880-4e98-b030-4377f367b5ac admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.695092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.695758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.696037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.696310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.697007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.698380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:11:51.698380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 23 17:11:51.698380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: Jun 23 17:11:51.699782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.709520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 781/1570] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/users => generated 300 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.710656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d40fad-48d4-4521-ade1-2ab0bb24475e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.724208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d40fad-48d4-4521-ade1-2ab0bb24475e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.729381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9b10a-7027-4b96-aeaf-3de1846dacc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.730087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9b10a-7027-4b96-aeaf-3de1846dacc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.730373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9b10a-7027-4b96-aeaf-3de1846dacc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.730497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 790/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.730696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9b10a-7027-4b96-aeaf-3de1846dacc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.731172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.731501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9b10a-7027-4b96-aeaf-3de1846dacc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.733758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9b10a-7027-4b96-aeaf-3de1846dacc0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.763049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 782/1572] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.766859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9b10a-7027-4b96-aeaf-3de1846dacc0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.792691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79367f-c8ff-45bd-8950-ce441623c49f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.832289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9b10a-7027-4b96-aeaf-3de1846dacc0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.837255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1a34a-3bcd-43ae-9930-c128e67aca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.837956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a34a-3bcd-43ae-9930-c128e67aca32 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.838242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a34a-3bcd-43ae-9930-c128e67aca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.838511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a34a-3bcd-43ae-9930-c128e67aca32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.839201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1a34a-3bcd-43ae-9930-c128e67aca32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.840834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:51.841111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1a34a-3bcd-43ae-9930-c128e67aca32 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.851390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e079ef-39ac-4488-95a1-4c1c7cc4e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.852063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e079ef-39ac-4488-95a1-4c1c7cc4e684 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.852558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e079ef-39ac-4488-95a1-4c1c7cc4e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.853190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e079ef-39ac-4488-95a1-4c1c7cc4e684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.853968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e079ef-39ac-4488-95a1-4c1c7cc4e684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.855910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e079ef-39ac-4488-95a1-4c1c7cc4e684 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.863599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:51.874777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 783/1573] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.874777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1a34a-3bcd-43ae-9930-c128e67aca32 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.888851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 791/1574] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:51.889881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e079ef-39ac-4488-95a1-4c1c7cc4e684 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.936962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1a34a-3bcd-43ae-9930-c128e67aca32 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.953557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e079ef-39ac-4488-95a1-4c1c7cc4e684 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.958602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4851cef-2a7c-44bf-a584-37892293d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.959272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4851cef-2a7c-44bf-a584-37892293d338 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.959555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4851cef-2a7c-44bf-a584-37892293d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.959829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4851cef-2a7c-44bf-a584-37892293d338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.960558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4851cef-2a7c-44bf-a584-37892293d338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.962186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4851cef-2a7c-44bf-a584-37892293d338 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.972127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 792/1575] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:51.972920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4851cef-2a7c-44bf-a584-37892293d338 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:51.982210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4851cef-2a7c-44bf-a584-37892293d338 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:51.986810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9e4bf-8561-4d7c-8bb2-7d28fc2fa95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.987814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9e4bf-8561-4d7c-8bb2-7d28fc2fa95d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.987960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9e4bf-8561-4d7c-8bb2-7d28fc2fa95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.988222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9e4bf-8561-4d7c-8bb2-7d28fc2fa95d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.988932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9e4bf-8561-4d7c-8bb2-7d28fc2fa95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.990574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9e4bf-8561-4d7c-8bb2-7d28fc2fa95d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:51.993947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bc9f-d156-49eb-8ce2-5bface8694a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:51.994619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bc9f-d156-49eb-8ce2-5bface8694a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:51.994899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bc9f-d156-49eb-8ce2-5bface8694a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:51.995173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8bc9f-d156-49eb-8ce2-5bface8694a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:51.995849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8bc9f-d156-49eb-8ce2-5bface8694a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:51.997755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8bc9f-d156-49eb-8ce2-5bface8694a9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.000438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 793/1576] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.001422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9e4bf-8561-4d7c-8bb2-7d28fc2fa95d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.013171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9e4bf-8561-4d7c-8bb2-7d28fc2fa95d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.018404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ba3d0-8139-407c-8d6e-ce62ad163b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.019224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ba3d0-8139-407c-8d6e-ce62ad163b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.019505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ba3d0-8139-407c-8d6e-ce62ad163b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.019946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ba3d0-8139-407c-8d6e-ce62ad163b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.020631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ba3d0-8139-407c-8d6e-ce62ad163b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.022268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ba3d0-8139-407c-8d6e-ce62ad163b7e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.024356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 784/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:51 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:52.025315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bc9f-d156-49eb-8ce2-5bface8694a9 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.036392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 794/1578] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.036392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ba3d0-8139-407c-8d6e-ce62ad163b7e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.046144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ba3d0-8139-407c-8d6e-ce62ad163b7e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.091170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8bc9f-d156-49eb-8ce2-5bface8694a9 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.096119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b471c-41e8-4160-af86-87ee634be58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.096992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b471c-41e8-4160-af86-87ee634be58c admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.097272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b471c-41e8-4160-af86-87ee634be58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.097559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b471c-41e8-4160-af86-87ee634be58c admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.098299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b471c-41e8-4160-af86-87ee634be58c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.100229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b471c-41e8-4160-af86-87ee634be58c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.121890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 785/1579] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:52.122905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b471c-41e8-4160-af86-87ee634be58c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.123097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59590938-991a-43cd-914d-1200009c537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.123796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59590938-991a-43cd-914d-1200009c537a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.124085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59590938-991a-43cd-914d-1200009c537a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.124364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59590938-991a-43cd-914d-1200009c537a admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.125168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59590938-991a-43cd-914d-1200009c537a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.127129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59590938-991a-43cd-914d-1200009c537a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.133228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b471c-41e8-4160-af86-87ee634be58c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.138393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37eb8aa-6983-4bea-a687-1dca9ecbfb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.139006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eb8aa-6983-4bea-a687-1dca9ecbfb09 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.139288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eb8aa-6983-4bea-a687-1dca9ecbfb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.139558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37eb8aa-6983-4bea-a687-1dca9ecbfb09 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.140260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37eb8aa-6983-4bea-a687-1dca9ecbfb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.142228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37eb8aa-6983-4bea-a687-1dca9ecbfb09 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.150597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 795/1580] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:52.151518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59590938-991a-43cd-914d-1200009c537a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.162647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59590938-991a-43cd-914d-1200009c537a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.167458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb8f67-e5cd-4623-bd9a-e7fb0515f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.171054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 786/1581] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:52.171218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb8f67-e5cd-4623-bd9a-e7fb0515f4af admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.171218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb8f67-e5cd-4623-bd9a-e7fb0515f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.171218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb8f67-e5cd-4623-bd9a-e7fb0515f4af admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.171488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37eb8aa-6983-4bea-a687-1dca9ecbfb09 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.171588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb8f67-e5cd-4623-bd9a-e7fb0515f4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.171588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb8f67-e5cd-4623-bd9a-e7fb0515f4af admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.173565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.179378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37eb8aa-6983-4bea-a687-1dca9ecbfb09 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.185506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910225d-82f2-44d1-9847-48f8d024252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.186203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910225d-82f2-44d1-9847-48f8d024252b admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.186536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910225d-82f2-44d1-9847-48f8d024252b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.186837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910225d-82f2-44d1-9847-48f8d024252b admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.187582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910225d-82f2-44d1-9847-48f8d024252b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.190129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910225d-82f2-44d1-9847-48f8d024252b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.194904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 796/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:52.195843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb8f67-e5cd-4623-bd9a-e7fb0515f4af admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.204895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 787/1583] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.205573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb8f67-e5cd-4623-bd9a-e7fb0515f4af admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.205776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910225d-82f2-44d1-9847-48f8d024252b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.210639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.211519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.211800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.212071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] PATH_INFO: `/v3/projects/e372f09ce33e4bc48d5a1c687a745585/users/f56c0a6e51d24da5bf2d89b79f33192b/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.216061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910225d-82f2-44d1-9847-48f8d024252b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.221281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78ebeb-7130-4d4a-8233-c5b722f23991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.221979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78ebeb-7130-4d4a-8233-c5b722f23991 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.222415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78ebeb-7130-4d4a-8233-c5b722f23991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.222686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78ebeb-7130-4d4a-8233-c5b722f23991 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.223369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78ebeb-7130-4d4a-8233-c5b722f23991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.225281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78ebeb-7130-4d4a-8233-c5b722f23991 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.227366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e372f09ce33e4bc48d5a1c687a745585, user_id=f56c0a6e51d24da5bf2d89b79f33192b, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.228488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:11:52.228488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 23 17:11:52.228488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: Jun 23 17:11:52.230503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.242632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.251701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 797/1584] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:52 2022] PUT /identity/v3/projects/e372f09ce33e4bc48d5a1c687a745585/users/f56c0a6e51d24da5bf2d89b79f33192b/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:52.251856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 788/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:52.253188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78ebeb-7130-4d4a-8233-c5b722f23991 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.254838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.265867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78ebeb-7130-4d4a-8233-c5b722f23991 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.320941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7d8f6-a148-43a2-b716-cbdc45a7d2c8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.323470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c0908-a4d8-42da-b753-c93c400eb0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.324152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0908-a4d8-42da-b753-c93c400eb0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.324428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0908-a4d8-42da-b753-c93c400eb0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.324696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c0908-a4d8-42da-b753-c93c400eb0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.325419 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c0908-a4d8-42da-b753-c93c400eb0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.325747 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163b03a-f0d8-4935-9eef-14c60bd0dfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.326447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163b03a-f0d8-4935-9eef-14c60bd0dfec admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.326734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163b03a-f0d8-4935-9eef-14c60bd0dfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.327014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163b03a-f0d8-4935-9eef-14c60bd0dfec admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.327122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c0908-a4d8-42da-b753-c93c400eb0d2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.327744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163b03a-f0d8-4935-9eef-14c60bd0dfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.329361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163b03a-f0d8-4935-9eef-14c60bd0dfec admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.337164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 789/1586] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.337991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c0908-a4d8-42da-b753-c93c400eb0d2 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.342153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 798/1587] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.342153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163b03a-f0d8-4935-9eef-14c60bd0dfec admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.348120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c0908-a4d8-42da-b753-c93c400eb0d2 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.352015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163b03a-f0d8-4935-9eef-14c60bd0dfec admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.353067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a31848-875a-44a7-8a40-11fdd8db025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.353739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a31848-875a-44a7-8a40-11fdd8db025d admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.354060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a31848-875a-44a7-8a40-11fdd8db025d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.354331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a31848-875a-44a7-8a40-11fdd8db025d admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.355041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a31848-875a-44a7-8a40-11fdd8db025d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.356629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a31848-875a-44a7-8a40-11fdd8db025d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.357274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86db2f5-6402-4796-ab6e-45f25a53c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.358203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86db2f5-6402-4796-ab6e-45f25a53c473 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.358558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86db2f5-6402-4796-ab6e-45f25a53c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.359230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86db2f5-6402-4796-ab6e-45f25a53c473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.360029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86db2f5-6402-4796-ab6e-45f25a53c473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.361696 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86db2f5-6402-4796-ab6e-45f25a53c473 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.367471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 790/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.368433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a31848-875a-44a7-8a40-11fdd8db025d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.373086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 799/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.374085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86db2f5-6402-4796-ab6e-45f25a53c473 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.379010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a31848-875a-44a7-8a40-11fdd8db025d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.383837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282ceb-62fd-41e8-833d-fc346904e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.384616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282ceb-62fd-41e8-833d-fc346904e25d admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.384800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86db2f5-6402-4796-ab6e-45f25a53c473 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.384911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282ceb-62fd-41e8-833d-fc346904e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.385150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282ceb-62fd-41e8-833d-fc346904e25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.385897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44282ceb-62fd-41e8-833d-fc346904e25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.387452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44282ceb-62fd-41e8-833d-fc346904e25d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.389429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae3edd-87b3-4f2c-a73c-9d3ca67495b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.390335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae3edd-87b3-4f2c-a73c-9d3ca67495b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.390617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae3edd-87b3-4f2c-a73c-9d3ca67495b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.390896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae3edd-87b3-4f2c-a73c-9d3ca67495b1 admin admin] PATH_INFO: `/v3/projects/0848835ae1ee48258fafb4df0ae3ced8/users/e038bb43276e413498ad02e67e34c89c/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.398709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 791/1590] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.401937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282ceb-62fd-41e8-833d-fc346904e25d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.409432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae3edd-87b3-4f2c-a73c-9d3ca67495b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0848835ae1ee48258fafb4df0ae3ced8, user_id=e038bb43276e413498ad02e67e34c89c, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.409614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282ceb-62fd-41e8-833d-fc346904e25d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.412243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae3edd-87b3-4f2c-a73c-9d3ca67495b1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.414211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcb85b-dcf3-4065-b2ea-b76f8f3f32a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.414896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb85b-dcf3-4065-b2ea-b76f8f3f32a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.415175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb85b-dcf3-4065-b2ea-b76f8f3f32a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.415508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb85b-dcf3-4065-b2ea-b76f8f3f32a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.416200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb85b-dcf3-4065-b2ea-b76f8f3f32a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.418038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb85b-dcf3-4065-b2ea-b76f8f3f32a2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.429216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 792/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.430774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2de0ed-f524-4103-b313-18140609059c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.431114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2de0ed-f524-4103-b313-18140609059c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.431460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2de0ed-f524-4103-b313-18140609059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.437676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 800/1592] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:52 2022] PUT /identity/v3/projects/0848835ae1ee48258fafb4df0ae3ced8/users/e038bb43276e413498ad02e67e34c89c/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:52.438581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae3edd-87b3-4f2c-a73c-9d3ca67495b1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.460475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0f2de0ed-f524-4103-b313-18140609059c None None] MFA Rules not processed for user `f56c0a6e51d24da5bf2d89b79f33192b`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:52.461625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0f2de0ed-f524-4103-b313-18140609059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:52.501153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae3edd-87b3-4f2c-a73c-9d3ca67495b1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.507123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddbe62-06ac-4c8c-b184-7817462714d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.507778 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddbe62-06ac-4c8c-b184-7817462714d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.508091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddbe62-06ac-4c8c-b184-7817462714d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.508334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddbe62-06ac-4c8c-b184-7817462714d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.509276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddbe62-06ac-4c8c-b184-7817462714d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.510714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddbe62-06ac-4c8c-b184-7817462714d4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.522081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 801/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.523040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddbe62-06ac-4c8c-b184-7817462714d4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.529385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 793/1594] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:52.530275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2de0ed-f524-4103-b313-18140609059c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.533058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddbe62-06ac-4c8c-b184-7817462714d4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.537760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79eeb6-0995-43e6-ba70-9206204086f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.538677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79eeb6-0995-43e6-ba70-9206204086f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.538956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79eeb6-0995-43e6-ba70-9206204086f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.539260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79eeb6-0995-43e6-ba70-9206204086f4 admin admin] PATH_INFO: `/v3/projects/adfd0d8dbe0e4b58a0d4d814493f0bb6/users/9e927e4ed8f44d4ca6e6be1b1386f403/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.543947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2de0ed-f524-4103-b313-18140609059c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.548888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22480fb6-27ad-41bd-838a-032782192fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.549826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480fb6-27ad-41bd-838a-032782192fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.550333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480fb6-27ad-41bd-838a-032782192fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.550631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480fb6-27ad-41bd-838a-032782192fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.551398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22480fb6-27ad-41bd-838a-032782192fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.553011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22480fb6-27ad-41bd-838a-032782192fe8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.555276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79eeb6-0995-43e6-ba70-9206204086f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfd0d8dbe0e4b58a0d4d814493f0bb6, user_id=9e927e4ed8f44d4ca6e6be1b1386f403, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.557896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79eeb6-0995-43e6-ba70-9206204086f4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.563851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 794/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.565295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22480fb6-27ad-41bd-838a-032782192fe8 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.573094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 802/1596] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:52 2022] PUT /identity/v3/projects/adfd0d8dbe0e4b58a0d4d814493f0bb6/users/9e927e4ed8f44d4ca6e6be1b1386f403/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:52.574195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79eeb6-0995-43e6-ba70-9206204086f4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.576136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22480fb6-27ad-41bd-838a-032782192fe8 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.589271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.613118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.640045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b96c0-3d0e-4987-97cf-e7c417c83de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.641022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b96c0-3d0e-4987-97cf-e7c417c83de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.641383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b96c0-3d0e-4987-97cf-e7c417c83de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.641728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b96c0-3d0e-4987-97cf-e7c417c83de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.642559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b96c0-3d0e-4987-97cf-e7c417c83de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.644364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b96c0-3d0e-4987-97cf-e7c417c83de7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.647467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79eeb6-0995-43e6-ba70-9206204086f4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.654025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c786df3-e984-47d5-b3d7-16d70208dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.655037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786df3-e984-47d5-b3d7-16d70208dc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.655484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786df3-e984-47d5-b3d7-16d70208dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.655907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c786df3-e984-47d5-b3d7-16d70208dc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.657106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c786df3-e984-47d5-b3d7-16d70208dc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.659195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 795/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.659924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c786df3-e984-47d5-b3d7-16d70208dc26 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.660607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b96c0-3d0e-4987-97cf-e7c417c83de7 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.679318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 803/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.679494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b96c0-3d0e-4987-97cf-e7c417c83de7 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.679623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4366604-0d8c-4c61-8a8a-c3bcac1ad08a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.679623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4366604-0d8c-4c61-8a8a-c3bcac1ad08a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.679623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4366604-0d8c-4c61-8a8a-c3bcac1ad08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.685271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2152749-b9ef-48cc-92bb-395590e25517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.686325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2152749-b9ef-48cc-92bb-395590e25517 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.686788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2152749-b9ef-48cc-92bb-395590e25517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.687239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2152749-b9ef-48cc-92bb-395590e25517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.688782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2152749-b9ef-48cc-92bb-395590e25517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.691327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2152749-b9ef-48cc-92bb-395590e25517 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.703654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 796/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:52.704490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2152749-b9ef-48cc-92bb-395590e25517 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.714668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2152749-b9ef-48cc-92bb-395590e25517 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.714836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e4366604-0d8c-4c61-8a8a-c3bcac1ad08a None None] MFA Rules not processed for user `e038bb43276e413498ad02e67e34c89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:52.716028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e4366604-0d8c-4c61-8a8a-c3bcac1ad08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:52.719348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be4bea-a508-4bf6-90c4-1d358d26596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.720259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be4bea-a508-4bf6-90c4-1d358d26596e admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.720573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be4bea-a508-4bf6-90c4-1d358d26596e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.720896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be4bea-a508-4bf6-90c4-1d358d26596e admin admin] PATH_INFO: `/v3/projects/ae4929b0a6cf47ae8424685c63b0e2e6/users/38ed2481dd7b45c69593b1f3174c2c17/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.735906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be4bea-a508-4bf6-90c4-1d358d26596e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4929b0a6cf47ae8424685c63b0e2e6, user_id=38ed2481dd7b45c69593b1f3174c2c17, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.738698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be4bea-a508-4bf6-90c4-1d358d26596e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.752184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 797/1600] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:52 2022] PUT /identity/v3/projects/ae4929b0a6cf47ae8424685c63b0e2e6/users/38ed2481dd7b45c69593b1f3174c2c17/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:52.753101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be4bea-a508-4bf6-90c4-1d358d26596e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.789276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 804/1601] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:52.790201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4366604-0d8c-4c61-8a8a-c3bcac1ad08a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.801619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4366604-0d8c-4c61-8a8a-c3bcac1ad08a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.818545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be4bea-a508-4bf6-90c4-1d358d26596e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.824834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3fd89-5d76-4c5d-9655-a06f852872e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.825878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3fd89-5d76-4c5d-9655-a06f852872e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.826341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3fd89-5d76-4c5d-9655-a06f852872e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.826595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3fd89-5d76-4c5d-9655-a06f852872e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.827567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3fd89-5d76-4c5d-9655-a06f852872e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.830377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3fd89-5d76-4c5d-9655-a06f852872e2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.859350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 798/1602] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:52.860809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6d8e-47cb-4248-8e6e-dff1965a530a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.861122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6d8e-47cb-4248-8e6e-dff1965a530a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.861399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c6d8e-47cb-4248-8e6e-dff1965a530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.871979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a16f7f-9917-40b8-9339-96fee4ded2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.872887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16f7f-9917-40b8-9339-96fee4ded2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.873166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16f7f-9917-40b8-9339-96fee4ded2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.873445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a16f7f-9917-40b8-9339-96fee4ded2ae admin admin] PATH_INFO: `/v3/projects/201cf53eaff642e78cf394182b0b9972/users/fc6a4d6c1f834720a69ee30d5ae63cc9/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.887485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b63c6d8e-47cb-4248-8e6e-dff1965a530a None None] MFA Rules not processed for user `9e927e4ed8f44d4ca6e6be1b1386f403`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:52.887985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a16f7f-9917-40b8-9339-96fee4ded2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=201cf53eaff642e78cf394182b0b9972, user_id=fc6a4d6c1f834720a69ee30d5ae63cc9, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.888804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b63c6d8e-47cb-4248-8e6e-dff1965a530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:52.890443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a16f7f-9917-40b8-9339-96fee4ded2ae admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:52.905466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 805/1603] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:52 2022] PUT /identity/v3/projects/201cf53eaff642e78cf394182b0b9972/users/fc6a4d6c1f834720a69ee30d5ae63cc9/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:52.906287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a16f7f-9917-40b8-9339-96fee4ded2ae admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.938678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.950302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:52.960363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 799/1604] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:52.961244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c6d8e-47cb-4248-8e6e-dff1965a530a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:52.968068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a16f7f-9917-40b8-9339-96fee4ded2ae admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:52.972752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ead35-58a2-4451-a0c8-8c75dc85ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:52.973779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ead35-58a2-4451-a0c8-8c75dc85ba7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:52.974082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ead35-58a2-4451-a0c8-8c75dc85ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:52.974354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ead35-58a2-4451-a0c8-8c75dc85ba7a admin admin] PATH_INFO: `/v3/projects/1078c824df3b4686b378082ba8ae56c7/users/c2d16c6da5e34d239b834532fd174fc3/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:52.989028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ead35-58a2-4451-a0c8-8c75dc85ba7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1078c824df3b4686b378082ba8ae56c7, user_id=c2d16c6da5e34d239b834532fd174fc3, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:52.991701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ead35-58a2-4451-a0c8-8c75dc85ba7a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.005469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 806/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:52 2022] PUT /identity/v3/projects/1078c824df3b4686b378082ba8ae56c7/users/c2d16c6da5e34d239b834532fd174fc3/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:53.006451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ead35-58a2-4451-a0c8-8c75dc85ba7a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.034036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c6d8e-47cb-4248-8e6e-dff1965a530a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.069236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ead35-58a2-4451-a0c8-8c75dc85ba7a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.074196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739e6b1-fc66-4e93-85e9-a05c77bbdc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.075128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e6b1-fc66-4e93-85e9-a05c77bbdc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.075404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e6b1-fc66-4e93-85e9-a05c77bbdc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.075645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e6b1-fc66-4e93-85e9-a05c77bbdc52 admin admin] PATH_INFO: `/v3/projects/8355cfdfed4f44f689922335c2845c50/users/41bc70e58a764f7e9e065aead58c425a/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.090176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739e6b1-fc66-4e93-85e9-a05c77bbdc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8355cfdfed4f44f689922335c2845c50, user_id=41bc70e58a764f7e9e065aead58c425a, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.092758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc633b2-ea8f-405a-b4c3-1e17e96f54cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.092938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739e6b1-fc66-4e93-85e9-a05c77bbdc52 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.093649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc633b2-ea8f-405a-b4c3-1e17e96f54cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.093959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc633b2-ea8f-405a-b4c3-1e17e96f54cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.094229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc633b2-ea8f-405a-b4c3-1e17e96f54cc admin admin] PATH_INFO: `/v3/projects/bec9016d905e4d29b8e7c3f63c8a8810/users/ccfccebbea724eca8909be4fea93a58f/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.107315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 807/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:53 2022] PUT /identity/v3/projects/8355cfdfed4f44f689922335c2845c50/users/41bc70e58a764f7e9e065aead58c425a/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:53.109616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc633b2-ea8f-405a-b4c3-1e17e96f54cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec9016d905e4d29b8e7c3f63c8a8810, user_id=ccfccebbea724eca8909be4fea93a58f, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.111187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f28f-d881-47dd-a0c5-158e2ab995aa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.111475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f28f-d881-47dd-a0c5-158e2ab995aa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.111894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f28f-d881-47dd-a0c5-158e2ab995aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.112417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc633b2-ea8f-405a-b4c3-1e17e96f54cc admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.127434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 800/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:52 2022] PUT /identity/v3/projects/bec9016d905e4d29b8e7c3f63c8a8810/users/ccfccebbea724eca8909be4fea93a58f/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:53.129124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5ef3-327b-4c10-a4d1-df16d8ea8e7d None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.129507 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5ef3-327b-4c10-a4d1-df16d8ea8e7d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.130013 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5ef3-327b-4c10-a4d1-df16d8ea8e7d None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.131962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 801/1608] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 23 17:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:11:53.131962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5ef3-327b-4c10-a4d1-df16d8ea8e7d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.141856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-27f1f28f-d881-47dd-a0c5-158e2ab995aa None None] MFA Rules not processed for user `38ed2481dd7b45c69593b1f3174c2c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:53.143333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-27f1f28f-d881-47dd-a0c5-158e2ab995aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:53.196212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5ef3-327b-4c10-a4d1-df16d8ea8e7d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.201075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7da049-c31d-494a-b427-924b34d9ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.201778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da049-c31d-494a-b427-924b34d9ad36 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.202094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da049-c31d-494a-b427-924b34d9ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.202368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da049-c31d-494a-b427-924b34d9ad36 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.203060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7da049-c31d-494a-b427-924b34d9ad36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.205017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7da049-c31d-494a-b427-924b34d9ad36 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.209316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 808/1609] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:53.210979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2665-4d33-4f4c-9f59-b54eda433f69 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.211273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2665-4d33-4f4c-9f59-b54eda433f69 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.211549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2665-4d33-4f4c-9f59-b54eda433f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.234056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 802/1610] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:53.234056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7da049-c31d-494a-b427-924b34d9ad36 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.235912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d96b2665-4d33-4f4c-9f59-b54eda433f69 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:53.238945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d96b2665-4d33-4f4c-9f59-b54eda433f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:53.242540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7da049-c31d-494a-b427-924b34d9ad36 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.248083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcf0e7-df22-45d6-b010-ddce8353577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.251906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 809/1611] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:53.252105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcf0e7-df22-45d6-b010-ddce8353577f admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.252105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcf0e7-df22-45d6-b010-ddce8353577f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.252105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcf0e7-df22-45d6-b010-ddce8353577f admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.252698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2dce-255a-4cbb-9004-c360ed9f3e9d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.252698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2dce-255a-4cbb-9004-c360ed9f3e9d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.252879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcf0e7-df22-45d6-b010-ddce8353577f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.252999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd2dce-255a-4cbb-9004-c360ed9f3e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.253111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcf0e7-df22-45d6-b010-ddce8353577f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.263801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:53.279327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d6dd2dce-255a-4cbb-9004-c360ed9f3e9d None None] MFA Rules not processed for user `c2d16c6da5e34d239b834532fd174fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:53.280543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d6dd2dce-255a-4cbb-9004-c360ed9f3e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:53.283337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 803/1612] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:53.284565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87012-3acd-422d-8e6f-ba53cba23132 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.284857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87012-3acd-422d-8e6f-ba53cba23132 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.285147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87012-3acd-422d-8e6f-ba53cba23132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.301573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:53.301948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-89d87012-3acd-422d-8e6f-ba53cba23132 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:53.303202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-89d87012-3acd-422d-8e6f-ba53cba23132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:53.351347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 810/1613] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:53.353818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdacd18-2f63-46f2-8c44-bdc817c0347b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.354256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdacd18-2f63-46f2-8c44-bdc817c0347b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.354816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdacd18-2f63-46f2-8c44-bdc817c0347b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.364638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 804/1614] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:53.365971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad9355-91d7-4f5d-a92c-5af112def41b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.366410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad9355-91d7-4f5d-a92c-5af112def41b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.366691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad9355-91d7-4f5d-a92c-5af112def41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.374593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-acdacd18-2f63-46f2-8c44-bdc817c0347b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:53.375802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-acdacd18-2f63-46f2-8c44-bdc817c0347b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:53.383428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 811/1615] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:53.384706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18457a1c-253c-43aa-b7ef-6e9f49412b3d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.384983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18457a1c-253c-43aa-b7ef-6e9f49412b3d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.385252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18457a1c-253c-43aa-b7ef-6e9f49412b3d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.387503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-10ad9355-91d7-4f5d-a92c-5af112def41b None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:53.388708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-10ad9355-91d7-4f5d-a92c-5af112def41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:53.389935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 812/1616] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jun 23 17:11:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:11:53.391338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18457a1c-253c-43aa-b7ef-6e9f49412b3d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.404698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18457a1c-253c-43aa-b7ef-6e9f49412b3d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.409387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70893396-edd1-485b-a33d-2a11604af7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.410060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893396-edd1-485b-a33d-2a11604af7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.410344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893396-edd1-485b-a33d-2a11604af7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.410618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893396-edd1-485b-a33d-2a11604af7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.411356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70893396-edd1-485b-a33d-2a11604af7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.412968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70893396-edd1-485b-a33d-2a11604af7c9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.422809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 813/1617] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:53.423604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70893396-edd1-485b-a33d-2a11604af7c9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.461233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 805/1618] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:53.462196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad9355-91d7-4f5d-a92c-5af112def41b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.473207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad9355-91d7-4f5d-a92c-5af112def41b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.477862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acb7f1-17ce-4a3a-8a65-a64af9578a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.478526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb7f1-17ce-4a3a-8a65-a64af9578a6d admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.478645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70893396-edd1-485b-a33d-2a11604af7c9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.478807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb7f1-17ce-4a3a-8a65-a64af9578a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.479083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb7f1-17ce-4a3a-8a65-a64af9578a6d admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.479781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acb7f1-17ce-4a3a-8a65-a64af9578a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.481706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acb7f1-17ce-4a3a-8a65-a64af9578a6d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.482137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5beaf-52ab-456e-be26-4538413db791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.482780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5beaf-52ab-456e-be26-4538413db791 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.483057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5beaf-52ab-456e-be26-4538413db791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.483328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5beaf-52ab-456e-be26-4538413db791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.492608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5beaf-52ab-456e-be26-4538413db791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.494072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5beaf-52ab-456e-be26-4538413db791 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.503141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 806/1619] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/users => generated 306 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:11:53.503985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 814/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:53.504109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acb7f1-17ce-4a3a-8a65-a64af9578a6d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.504575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5beaf-52ab-456e-be26-4538413db791 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.513733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5beaf-52ab-456e-be26-4538413db791 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.517670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b6f16-00b3-4973-b6e9-2153527c369c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.518473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6f16-00b3-4973-b6e9-2153527c369c service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.518755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6f16-00b3-4973-b6e9-2153527c369c service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.519026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6f16-00b3-4973-b6e9-2153527c369c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.529695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b6f16-00b3-4973-b6e9-2153527c369c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.531733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b6f16-00b3-4973-b6e9-2153527c369c service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.546755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 815/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:53.548105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48864-dcc4-4770-8429-89097c89334b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.548402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48864-dcc4-4770-8429-89097c89334b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.548680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48864-dcc4-4770-8429-89097c89334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.567670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7ac48864-dcc4-4770-8429-89097c89334b None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:53.569129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7ac48864-dcc4-4770-8429-89097c89334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:53.574271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acb7f1-17ce-4a3a-8a65-a64af9578a6d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.578504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fc69b-d1ab-4335-b869-628c8d23cbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.579415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc69b-d1ab-4335-b869-628c8d23cbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.579415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc69b-d1ab-4335-b869-628c8d23cbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.579415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fc69b-d1ab-4335-b869-628c8d23cbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.581723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 816/1622] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jun 23 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:53.582620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac48864-dcc4-4770-8429-89097c89334b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.591757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fc69b-d1ab-4335-b869-628c8d23cbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.593713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fc69b-d1ab-4335-b869-628c8d23cbf5 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.593882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac48864-dcc4-4770-8429-89097c89334b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.598866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ec59e-b271-4205-a566-21c57e58fa2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.599654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec59e-b271-4205-a566-21c57e58fa2f service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.600052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec59e-b271-4205-a566-21c57e58fa2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.600367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec59e-b271-4205-a566-21c57e58fa2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.604997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 807/1623] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:53.605672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fc69b-d1ab-4335-b869-628c8d23cbf5 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.610991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ec59e-b271-4205-a566-21c57e58fa2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.612466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ec59e-b271-4205-a566-21c57e58fa2f service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.617714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fc69b-d1ab-4335-b869-628c8d23cbf5 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.623698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265978b-4e57-436d-bda4-ca82f0ec5da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.623876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 817/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:53.624626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265978b-4e57-436d-bda4-ca82f0ec5da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.624960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265978b-4e57-436d-bda4-ca82f0ec5da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.625116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ec59e-b271-4205-a566-21c57e58fa2f service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.625284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265978b-4e57-436d-bda4-ca82f0ec5da6 admin admin] PATH_INFO: `/v3/projects/e87d2e3ad16f4f958a4f56219931095e/users/001885178ebd48a689f53120c99f0298/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.628753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:53.640305 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ec59e-b271-4205-a566-21c57e58fa2f service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.647287 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265978b-4e57-436d-bda4-ca82f0ec5da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87d2e3ad16f4f958a4f56219931095e, user_id=001885178ebd48a689f53120c99f0298, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.649738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8ba9-e980-4225-a850-12cd641ac492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.650181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8ba9-e980-4225-a850-12cd641ac492 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.650468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8ba9-e980-4225-a850-12cd641ac492 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.650721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265978b-4e57-436d-bda4-ca82f0ec5da6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.650858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f8ba9-e980-4225-a850-12cd641ac492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.674296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 808/1625] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:53 2022] PUT /identity/v3/projects/e87d2e3ad16f4f958a4f56219931095e/users/001885178ebd48a689f53120c99f0298/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:53.678675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265978b-4e57-436d-bda4-ca82f0ec5da6 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.739879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f8ba9-e980-4225-a850-12cd641ac492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.744448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f8ba9-e980-4225-a850-12cd641ac492 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.761479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 818/1626] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:53.762550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8ba9-e980-4225-a850-12cd641ac492 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.777591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f8ba9-e980-4225-a850-12cd641ac492 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.793264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:53.807897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265978b-4e57-436d-bda4-ca82f0ec5da6 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.822637 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fccd0-19ee-4d5b-a8be-39c126d86070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.823687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fccd0-19ee-4d5b-a8be-39c126d86070 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.823978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fccd0-19ee-4d5b-a8be-39c126d86070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.824266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fccd0-19ee-4d5b-a8be-39c126d86070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.825017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fccd0-19ee-4d5b-a8be-39c126d86070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.826873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fccd0-19ee-4d5b-a8be-39c126d86070 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.856468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 809/1627] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:53.856468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fccd0-19ee-4d5b-a8be-39c126d86070 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.870948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fccd0-19ee-4d5b-a8be-39c126d86070 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.876476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349d12-5150-4847-a76e-b904f1cb063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.877134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349d12-5150-4847-a76e-b904f1cb063f admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.877783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349d12-5150-4847-a76e-b904f1cb063f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.877950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349d12-5150-4847-a76e-b904f1cb063f admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.878757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349d12-5150-4847-a76e-b904f1cb063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:53.880695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349d12-5150-4847-a76e-b904f1cb063f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:53.892652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 810/1628] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:53.893895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349d12-5150-4847-a76e-b904f1cb063f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:53.906560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca879f-d171-4164-8a92-2df08b30a734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.907508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca879f-d171-4164-8a92-2df08b30a734 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.908003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca879f-d171-4164-8a92-2df08b30a734 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.910061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca879f-d171-4164-8a92-2df08b30a734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:53.929758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349d12-5150-4847-a76e-b904f1cb063f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:53.955287 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b7a8-7802-4051-973c-6d00ffdbc699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:53.956732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b7a8-7802-4051-973c-6d00ffdbc699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:53.959974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b7a8-7802-4051-973c-6d00ffdbc699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:53.961786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b7a8-7802-4051-973c-6d00ffdbc699 admin admin] PATH_INFO: `/v3/projects/52cfe4503b6f40779e8b9370380036e5/users/e2965bdb5e1642e68942286d4f095ec2/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.002938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247b7a8-7802-4051-973c-6d00ffdbc699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cfe4503b6f40779e8b9370380036e5, user_id=e2965bdb5e1642e68942286d4f095ec2, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:54.006465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247b7a8-7802-4051-973c-6d00ffdbc699 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:54.019020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca879f-d171-4164-8a92-2df08b30a734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:54.021976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca879f-d171-4164-8a92-2df08b30a734 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:54.041176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 811/1629] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:53 2022] PUT /identity/v3/projects/52cfe4503b6f40779e8b9370380036e5/users/e2965bdb5e1642e68942286d4f095ec2/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:54.041851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b7a8-7802-4051-973c-6d00ffdbc699 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:54.055454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 819/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:54.059017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca879f-d171-4164-8a92-2df08b30a734 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:54.086040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca879f-d171-4164-8a92-2df08b30a734 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:54.123949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b7a8-7802-4051-973c-6d00ffdbc699 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:54.129272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee2f7-82ec-4499-bb18-10c8fc6115f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:54.130223 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee2f7-82ec-4499-bb18-10c8fc6115f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.130506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee2f7-82ec-4499-bb18-10c8fc6115f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.130783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee2f7-82ec-4499-bb18-10c8fc6115f4 admin admin] PATH_INFO: `/v3/projects/e87d2e3ad16f4f958a4f56219931095e/users/001885178ebd48a689f53120c99f0298/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.133573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ee2f7-82ec-4499-bb18-10c8fc6115f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87d2e3ad16f4f958a4f56219931095e, user_id=001885178ebd48a689f53120c99f0298, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:54.136509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ee2f7-82ec-4499-bb18-10c8fc6115f4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:54.149471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 812/1631] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:54 2022] PUT /identity/v3/projects/e87d2e3ad16f4f958a4f56219931095e/users/001885178ebd48a689f53120c99f0298/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:54.161616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80f62-7d6f-4298-924b-e84d20924103 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.161932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80f62-7d6f-4298-924b-e84d20924103 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.162214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80f62-7d6f-4298-924b-e84d20924103 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.163934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 813/1632] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 23 17:11:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:11:54.164795 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56112d8-507e-458e-8b31-c0e403d1a1f4 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.165075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56112d8-507e-458e-8b31-c0e403d1a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.165354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56112d8-507e-458e-8b31-c0e403d1a1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.194513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab83e4-a78e-4b56-882f-49981c684774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:54.195803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab83e4-a78e-4b56-882f-49981c684774 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.196265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab83e4-a78e-4b56-882f-49981c684774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.196826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab83e4-a78e-4b56-882f-49981c684774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.198370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab83e4-a78e-4b56-882f-49981c684774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:54.200841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab83e4-a78e-4b56-882f-49981c684774 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:54.202266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b56112d8-507e-458e-8b31-c0e403d1a1f4 None None] MFA Rules not processed for user `001885178ebd48a689f53120c99f0298`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:54.204717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b56112d8-507e-458e-8b31-c0e403d1a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:54.221338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 820/1633] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:11:54.224440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3faa-dec6-446d-8d73-a00a3dba5fb5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.224929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3faa-dec6-446d-8d73-a00a3dba5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.225426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3faa-dec6-446d-8d73-a00a3dba5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.254355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0ead3faa-dec6-446d-8d73-a00a3dba5fb5 None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:54.256237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0ead3faa-dec6-446d-8d73-a00a3dba5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:54.263338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:54.324873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:54.425840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 814/1634] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:54.432290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56112d8-507e-458e-8b31-c0e403d1a1f4 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:54.455470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 821/1635] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:54.468945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3faa-dec6-446d-8d73-a00a3dba5fb5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:54.596835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56112d8-507e-458e-8b31-c0e403d1a1f4 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:54.606996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3faa-dec6-446d-8d73-a00a3dba5fb5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:54.609658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06e4b3-a727-4c7d-993d-ee7918a06250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:54.611188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06e4b3-a727-4c7d-993d-ee7918a06250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.616515 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06e4b3-a727-4c7d-993d-ee7918a06250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.617065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06e4b3-a727-4c7d-993d-ee7918a06250 admin admin] PATH_INFO: `/v3/projects/52cfe4503b6f40779e8b9370380036e5/users/e2965bdb5e1642e68942286d4f095ec2/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.622978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4263-9662-45e1-ac1e-4a13c6182aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:54.623664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4263-9662-45e1-ac1e-4a13c6182aaf service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.623951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4263-9662-45e1-ac1e-4a13c6182aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.624684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06e4b3-a727-4c7d-993d-ee7918a06250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cfe4503b6f40779e8b9370380036e5, user_id=e2965bdb5e1642e68942286d4f095ec2, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:54.624817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4263-9662-45e1-ac1e-4a13c6182aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.627839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06e4b3-a727-4c7d-993d-ee7918a06250 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:54.643190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c4263-9662-45e1-ac1e-4a13c6182aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:54.648871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 815/1636] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:11:54 2022] PUT /identity/v3/projects/52cfe4503b6f40779e8b9370380036e5/users/e2965bdb5e1642e68942286d4f095ec2/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:54.650045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c4263-9662-45e1-ac1e-4a13c6182aaf service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:54.650743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06e4b3-a727-4c7d-993d-ee7918a06250 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:54.678993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 822/1637] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:54.684357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f5b7-5833-40eb-b0c8-4656999e1c4d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.684683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f5b7-5833-40eb-b0c8-4656999e1c4d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.684952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9f5b7-5833-40eb-b0c8-4656999e1c4d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.688587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 823/1638] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 23 17:11:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:11:54.692337 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69634c4-9a41-4027-a891-d8cd45a5178a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.692640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69634c4-9a41-4027-a891-d8cd45a5178a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.692927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69634c4-9a41-4027-a891-d8cd45a5178a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.739897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e69634c4-9a41-4027-a891-d8cd45a5178a None None] MFA Rules not processed for user `e2965bdb5e1642e68942286d4f095ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:54.741207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e69634c4-9a41-4027-a891-d8cd45a5178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:54.774415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06e4b3-a727-4c7d-993d-ee7918a06250 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:54.778517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305d5a-1e78-4f34-91d3-eb4be5888662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:54.779499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305d5a-1e78-4f34-91d3-eb4be5888662 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.779770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305d5a-1e78-4f34-91d3-eb4be5888662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.780043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305d5a-1e78-4f34-91d3-eb4be5888662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.885229 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 824/1639] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:54.887437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deb7f6-c63d-4e67-b488-6152188becb2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.887739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deb7f6-c63d-4e67-b488-6152188becb2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.888062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deb7f6-c63d-4e67-b488-6152188becb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.920126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f6deb7f6-c63d-4e67-b488-6152188becb2 None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:54.921375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f6deb7f6-c63d-4e67-b488-6152188becb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:11:54.932083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b305d5a-1e78-4f34-91d3-eb4be5888662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:54.934808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b305d5a-1e78-4f34-91d3-eb4be5888662 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:54.949484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 825/1640] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:11:54.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:54.950562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deb7f6-c63d-4e67-b488-6152188becb2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:54.961171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deb7f6-c63d-4e67-b488-6152188becb2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:54.967146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c882a5-ee7e-4a1e-bce7-f3960a610c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:54.968175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c882a5-ee7e-4a1e-bce7-f3960a610c77 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:54.968709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c882a5-ee7e-4a1e-bce7-f3960a610c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:54.969048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c882a5-ee7e-4a1e-bce7-f3960a610c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:54.981934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 816/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:55.075971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:11:55.079676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c882a5-ee7e-4a1e-bce7-f3960a610c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:55.083399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c882a5-ee7e-4a1e-bce7-f3960a610c77 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:55.108477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 826/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:55.368096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305d5a-1e78-4f34-91d3-eb4be5888662 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:55.385033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305d5a-1e78-4f34-91d3-eb4be5888662 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:55.396923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fb034-8afa-43aa-9693-cab268b2a9f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:55.399061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fb034-8afa-43aa-9693-cab268b2a9f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:55.399701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fb034-8afa-43aa-9693-cab268b2a9f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:55.400565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fb034-8afa-43aa-9693-cab268b2a9f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:55.420296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fb034-8afa-43aa-9693-cab268b2a9f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:55.423942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fb034-8afa-43aa-9693-cab268b2a9f9 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:55.456826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 817/1643] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:55.508186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c882a5-ee7e-4a1e-bce7-f3960a610c77 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:55.520635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c882a5-ee7e-4a1e-bce7-f3960a610c77 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:55.526795 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442027-755d-4ac8-a935-c4a809c56a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:55.528789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442027-755d-4ac8-a935-c4a809c56a16 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:55.529157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442027-755d-4ac8-a935-c4a809c56a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:55.542492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442027-755d-4ac8-a935-c4a809c56a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:55.561258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442027-755d-4ac8-a935-c4a809c56a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:55.564088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442027-755d-4ac8-a935-c4a809c56a16 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:55.609727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 827/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:56.291395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fb034-8afa-43aa-9693-cab268b2a9f9 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:56.301498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fb034-8afa-43aa-9693-cab268b2a9f9 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:56.309911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f2ae5-d916-43a8-be50-5be57b962a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:56.312928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f2ae5-d916-43a8-be50-5be57b962a7e service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:56.314095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f2ae5-d916-43a8-be50-5be57b962a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:56.316190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f2ae5-d916-43a8-be50-5be57b962a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:56.465051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f2ae5-d916-43a8-be50-5be57b962a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:56.467179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f2ae5-d916-43a8-be50-5be57b962a7e service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:56.497512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 818/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:11:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:11:59.367548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442027-755d-4ac8-a935-c4a809c56a16 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:11:59.579011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442027-755d-4ac8-a935-c4a809c56a16 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:11:59.598311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:11:59.599618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:59.600043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:59.600462 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] PATH_INFO: `/v3/users/e038bb43276e413498ad02e67e34c89c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:59.607330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e038bb43276e413498ad02e67e34c89c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:11:59.608406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:11:59.608406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 23 17:11:59.608406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: Jun 23 17:11:59.609591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:11:59.785484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e038bb43276e413498ad02e67e34c89c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:11:59.786381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e038bb43276e413498ad02e67e34c89c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:11:59.806536 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e038bb43276e413498ad02e67e34c89c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:11:59.835936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e038bb43276e413498ad02e67e34c89c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:11:59.893005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e038bb43276e413498ad02e67e34c89c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:11:59.912654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 828/1646] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:11:59 2022] DELETE /identity/v3/users/e038bb43276e413498ad02e67e34c89c => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:11:59.914993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001af8-a9f1-4d29-ab41-1adff608fbf2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:11:59.915849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001af8-a9f1-4d29-ab41-1adff608fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:11:59.916301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001af8-a9f1-4d29-ab41-1adff608fbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:11:59.940671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-52001af8-a9f1-4d29-ab41-1adff608fbf2 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:11:59.942394 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-52001af8-a9f1-4d29-ab41-1adff608fbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:00.024641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 819/1647] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:00.093190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:00.095014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:00.256399 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6c2cb-8a89-4627-8e46-1e91d15a5ac8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:00.263665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d478bfa-c594-4baa-8df3-3e2fc1394203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:00.264673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d478bfa-c594-4baa-8df3-3e2fc1394203 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:00.265265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d478bfa-c594-4baa-8df3-3e2fc1394203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:00.266344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d478bfa-c594-4baa-8df3-3e2fc1394203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:00.284885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d478bfa-c594-4baa-8df3-3e2fc1394203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:00.288004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d478bfa-c594-4baa-8df3-3e2fc1394203 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:00.312731 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 829/1648] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:01.582433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52001af8-a9f1-4d29-ab41-1adff608fbf2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:01.584264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-52001af8-a9f1-4d29-ab41-1adff608fbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:01.612166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52001af8-a9f1-4d29-ab41-1adff608fbf2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:01.629147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:01.631119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:01.631639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:01.632139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] PATH_INFO: `/v3/projects/0848835ae1ee48258fafb4df0ae3ced8` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:01.634829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0848835ae1ee48258fafb4df0ae3ced8)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:01.638844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: WARNING py.warnings [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 17:12:01.638844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: warnings.warn(msg) Jun 23 17:12:01.638844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: Jun 23 17:12:01.643315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:01.818055 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0848835ae1ee48258fafb4df0ae3ced8', 'request_id': 'req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:01.840294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0848835ae1ee48258fafb4df0ae3ced8', 'request_id': 'req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:01.917132 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0848835ae1ee48258fafb4df0ae3ced8', 'request_id': 'req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:01.946377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] The token cache is being invalidate because project 0848835ae1ee48258fafb4df0ae3ced8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:01.946878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:01.947843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9dbe5a9a-b9e9-42f3-88fc-869102d2faf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:01.957888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 820/1649] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:01 2022] DELETE /identity/v3/projects/0848835ae1ee48258fafb4df0ae3ced8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:01.958269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a98c13-fdab-4475-bd51-6d52c1a063bb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:01.958697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a98c13-fdab-4475-bd51-6d52c1a063bb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:01.958854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a98c13-fdab-4475-bd51-6d52c1a063bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:01.969705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:01.998944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b0a98c13-fdab-4475-bd51-6d52c1a063bb None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:02.000175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b0a98c13-fdab-4475-bd51-6d52c1a063bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:02.135061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 830/1650] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:02.141309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1a0e-d787-455f-9f58-63cd6677a9c6 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:02.141760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1a0e-d787-455f-9f58-63cd6677a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:02.142252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1a0e-d787-455f-9f58-63cd6677a9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:02.201194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:02.218786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0a0b1a0e-d787-455f-9f58-63cd6677a9c6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:02.220072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0a0b1a0e-d787-455f-9f58-63cd6677a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:02.286107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a98c13-fdab-4475-bd51-6d52c1a063bb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:02.291956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 821/1651] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:02.298712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a98c13-fdab-4475-bd51-6d52c1a063bb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:02.307616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:02.308415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:02.308789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:02.309183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:02.310157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:02.310678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:02.312965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:02.337398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 831/1652] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:02.338195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b1a0e-d787-455f-9f58-63cd6677a9c6 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:02.353868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b1a0e-d787-455f-9f58-63cd6677a9c6 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:02.366814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f367cc-2ebe-4e41-b5b7-bf56c46dac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:02.367755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f367cc-2ebe-4e41-b5b7-bf56c46dac5f admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:02.368110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f367cc-2ebe-4e41-b5b7-bf56c46dac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:02.368450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f367cc-2ebe-4e41-b5b7-bf56c46dac5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:02.369336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f367cc-2ebe-4e41-b5b7-bf56c46dac5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:02.371465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f367cc-2ebe-4e41-b5b7-bf56c46dac5f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:02.438653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 822/1653] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:02 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:02.443083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:02.468712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a046-2489-4b6f-b29b-9544f79cc7f2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:02.646414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d555f3-0e1f-419c-b1a8-a3e20656bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:02.647536 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d555f3-0e1f-419c-b1a8-a3e20656bf63 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:02.647845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d555f3-0e1f-419c-b1a8-a3e20656bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:02.648132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d555f3-0e1f-419c-b1a8-a3e20656bf63 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:02.649012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d555f3-0e1f-419c-b1a8-a3e20656bf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:02.652245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d555f3-0e1f-419c-b1a8-a3e20656bf63 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:02.707991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 832/1654] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:02 2022] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:02.711953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f367cc-2ebe-4e41-b5b7-bf56c46dac5f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:02.762611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f367cc-2ebe-4e41-b5b7-bf56c46dac5f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:02.779701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3d801-ffb6-4ec9-a17f-fb6787919d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:02.780631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d801-ffb6-4ec9-a17f-fb6787919d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:02.781117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d801-ffb6-4ec9-a17f-fb6787919d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:02.781526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3d801-ffb6-4ec9-a17f-fb6787919d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:02.782491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3d801-ffb6-4ec9-a17f-fb6787919d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:02.786484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3d801-ffb6-4ec9-a17f-fb6787919d00 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:02.834110 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 823/1655] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:02.834703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d555f3-0e1f-419c-b1a8-a3e20656bf63 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:02.852032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d555f3-0e1f-419c-b1a8-a3e20656bf63 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:02.865155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa11d98-8530-4db9-a9d0-5009087d999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:02.865894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11d98-8530-4db9-a9d0-5009087d999a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:02.866178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11d98-8530-4db9-a9d0-5009087d999a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:02.866454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11d98-8530-4db9-a9d0-5009087d999a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:02.867197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa11d98-8530-4db9-a9d0-5009087d999a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:02.869102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa11d98-8530-4db9-a9d0-5009087d999a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:02.899153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f67e5d-abab-47f5-94a5-1122d7f43e2c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:02.899554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f67e5d-abab-47f5-94a5-1122d7f43e2c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:02.899946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f67e5d-abab-47f5-94a5-1122d7f43e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:02.900981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 833/1656] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:12:02.904953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa11d98-8530-4db9-a9d0-5009087d999a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:02.921353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa11d98-8530-4db9-a9d0-5009087d999a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:02.928767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a229fa2-1dc3-44d0-91fd-4178f1f9dba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:02.929864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a229fa2-1dc3-44d0-91fd-4178f1f9dba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:02.930265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a229fa2-1dc3-44d0-91fd-4178f1f9dba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:02.930636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a229fa2-1dc3-44d0-91fd-4178f1f9dba3 admin admin] PATH_INFO: `/v3/projects/f2eb7c36aad74f838fca3c5fffb2676c/users/31b76cf6b35d49dfad1dfbd90b66cd58/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:02.951686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-96f67e5d-abab-47f5-94a5-1122d7f43e2c None None] MFA Rules not processed for user `fc6a4d6c1f834720a69ee30d5ae63cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:02.953842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-96f67e5d-abab-47f5-94a5-1122d7f43e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:02.959717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a229fa2-1dc3-44d0-91fd-4178f1f9dba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2eb7c36aad74f838fca3c5fffb2676c, user_id=31b76cf6b35d49dfad1dfbd90b66cd58, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:02.963358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a229fa2-1dc3-44d0-91fd-4178f1f9dba3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:02.996849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 834/1657] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:02 2022] PUT /identity/v3/projects/f2eb7c36aad74f838fca3c5fffb2676c/users/31b76cf6b35d49dfad1dfbd90b66cd58/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:03.003741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb772e81-5985-4c6f-a10b-f7e0c4a37bd1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:03.004132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb772e81-5985-4c6f-a10b-f7e0c4a37bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:03.004573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb772e81-5985-4c6f-a10b-f7e0c4a37bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:03.037515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-eb772e81-5985-4c6f-a10b-f7e0c4a37bd1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:03.047153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eb772e81-5985-4c6f-a10b-f7e0c4a37bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:03.148316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:03.181035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 824/1658] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:03.194504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 835/1659] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:03.198114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f67e5d-abab-47f5-94a5-1122d7f43e2c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:03.199654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-96f67e5d-abab-47f5-94a5-1122d7f43e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:03.209554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb772e81-5985-4c6f-a10b-f7e0c4a37bd1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:03.212165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eb772e81-5985-4c6f-a10b-f7e0c4a37bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:03.345721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb772e81-5985-4c6f-a10b-f7e0c4a37bd1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:03.360574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8485b39-19b8-4423-82c6-a00dc6e05111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:03.362558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485b39-19b8-4423-82c6-a00dc6e05111 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:03.364165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485b39-19b8-4423-82c6-a00dc6e05111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:03.364453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485b39-19b8-4423-82c6-a00dc6e05111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:03.368991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f67e5d-abab-47f5-94a5-1122d7f43e2c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:03.394359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8485b39-19b8-4423-82c6-a00dc6e05111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:03.396141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8485b39-19b8-4423-82c6-a00dc6e05111 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:03.423336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 836/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:12:03.483722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:03.516276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b3335-fe28-4a33-ac10-07a6307c2d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:03.516688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b3335-fe28-4a33-ac10-07a6307c2d37 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:03.517779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b3335-fe28-4a33-ac10-07a6307c2d37 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:03.518315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b3335-fe28-4a33-ac10-07a6307c2d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:03.702894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b3335-fe28-4a33-ac10-07a6307c2d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:03.710507 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b3335-fe28-4a33-ac10-07a6307c2d37 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:03.738828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 825/1661] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:05.335507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a2816-ef07-458c-9a2b-97d330d0577c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:05.335969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a2816-ef07-458c-9a2b-97d330d0577c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:05.336067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a2816-ef07-458c-9a2b-97d330d0577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:05.427631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-217a2816-ef07-458c-9a2b-97d330d0577c None None] MFA Rules not processed for user `41bc70e58a764f7e9e065aead58c425a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:05.428887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-217a2816-ef07-458c-9a2b-97d330d0577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:05.475852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f637-74fb-4b78-9f8a-b625d0dddd05 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:05.476347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f637-74fb-4b78-9f8a-b625d0dddd05 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:05.476435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f637-74fb-4b78-9f8a-b625d0dddd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:05.579555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-20b3f637-74fb-4b78-9f8a-b625d0dddd05 None None] MFA Rules not processed for user `31b76cf6b35d49dfad1dfbd90b66cd58`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:05.580893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-20b3f637-74fb-4b78-9f8a-b625d0dddd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:05.581031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 837/1662] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:05.598961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba84bd-a1b6-4335-a9ad-725c05361759 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:05.599253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba84bd-a1b6-4335-a9ad-725c05361759 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:05.599533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba84bd-a1b6-4335-a9ad-725c05361759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:05.646144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2eba84bd-a1b6-4335-a9ad-725c05361759 None None] MFA Rules not processed for user `41bc70e58a764f7e9e065aead58c425a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:05.647823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2eba84bd-a1b6-4335-a9ad-725c05361759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:05.667065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 838/1663] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:05.678829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba84bd-a1b6-4335-a9ad-725c05361759 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:05.680603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2eba84bd-a1b6-4335-a9ad-725c05361759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:05.731394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba84bd-a1b6-4335-a9ad-725c05361759 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:05.745715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d53da-706a-448e-9eb0-c430d9f3729a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:05.748568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d53da-706a-448e-9eb0-c430d9f3729a service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:05.749097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d53da-706a-448e-9eb0-c430d9f3729a service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:05.750450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 826/1664] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:05.751014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d53da-706a-448e-9eb0-c430d9f3729a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:05.755435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f637-74fb-4b78-9f8a-b625d0dddd05 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:05.768688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d53da-706a-448e-9eb0-c430d9f3729a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:05.770359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d53da-706a-448e-9eb0-c430d9f3729a service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:05.781777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f637-74fb-4b78-9f8a-b625d0dddd05 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:05.790522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94203778-315d-46ba-bb86-7530df933550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:05.791225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94203778-315d-46ba-bb86-7530df933550 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:05.791504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94203778-315d-46ba-bb86-7530df933550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:05.791780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94203778-315d-46ba-bb86-7530df933550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:05.792496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94203778-315d-46ba-bb86-7530df933550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:05.801306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94203778-315d-46ba-bb86-7530df933550 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:05.802343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 839/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:05.896141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 827/1666] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:05 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:05.899798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d53da-706a-448e-9eb0-c430d9f3729a service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:05.922906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d53da-706a-448e-9eb0-c430d9f3729a service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:06.123492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda1bef-3684-4dee-800c-3143d5fd1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:06.124207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1bef-3684-4dee-800c-3143d5fd1811 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:06.124992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1bef-3684-4dee-800c-3143d5fd1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:06.125286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1bef-3684-4dee-800c-3143d5fd1811 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:06.126046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda1bef-3684-4dee-800c-3143d5fd1811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:06.128395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda1bef-3684-4dee-800c-3143d5fd1811 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:06.149720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:06.186814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 840/1667] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:05 2022] POST /identity/v3/users => generated 308 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:06.187850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94203778-315d-46ba-bb86-7530df933550 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:06.219787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94203778-315d-46ba-bb86-7530df933550 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:06.236517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360186be-138f-428a-8c32-eab8e012aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:06.238805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360186be-138f-428a-8c32-eab8e012aeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:06.239135 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360186be-138f-428a-8c32-eab8e012aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:06.239603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360186be-138f-428a-8c32-eab8e012aeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:06.240379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360186be-138f-428a-8c32-eab8e012aeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:06.242191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360186be-138f-428a-8c32-eab8e012aeb0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:06.275196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 828/1668] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:06.278079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda1bef-3684-4dee-800c-3143d5fd1811 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:06.307583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda1bef-3684-4dee-800c-3143d5fd1811 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:06.326372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed859e-5baa-451b-9905-19525e24d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:06.327455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed859e-5baa-451b-9905-19525e24d2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:06.327810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed859e-5baa-451b-9905-19525e24d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:06.334506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed859e-5baa-451b-9905-19525e24d2bb admin admin] PATH_INFO: `/v3/projects/ad18cf7b097f46fba2afa9188709ca9d/users/809079de313f43538082b45bd13e6a61/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:06.387028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed859e-5baa-451b-9905-19525e24d2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad18cf7b097f46fba2afa9188709ca9d, user_id=809079de313f43538082b45bd13e6a61, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:06.389949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed859e-5baa-451b-9905-19525e24d2bb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:06.421490 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 841/1669] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:06 2022] PUT /identity/v3/projects/ad18cf7b097f46fba2afa9188709ca9d/users/809079de313f43538082b45bd13e6a61/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:06.423125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360186be-138f-428a-8c32-eab8e012aeb0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:06.437225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360186be-138f-428a-8c32-eab8e012aeb0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:06.548460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:06.576769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dbc36-a69f-4382-883f-1e17f69a573b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:06.577039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dbc36-a69f-4382-883f-1e17f69a573b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:06.577316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dbc36-a69f-4382-883f-1e17f69a573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:06.583525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfebb1-67c4-48f1-af48-dcc202a7db8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:06.584208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfebb1-67c4-48f1-af48-dcc202a7db8d admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:06.587220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfebb1-67c4-48f1-af48-dcc202a7db8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:06.587701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfebb1-67c4-48f1-af48-dcc202a7db8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:06.588703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfebb1-67c4-48f1-af48-dcc202a7db8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:06.590624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfebb1-67c4-48f1-af48-dcc202a7db8d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:06.605127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 829/1670] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:06.608961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfebb1-67c4-48f1-af48-dcc202a7db8d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:06.634468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfebb1-67c4-48f1-af48-dcc202a7db8d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:06.639190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-967dbc36-a69f-4382-883f-1e17f69a573b None None] MFA Rules not processed for user `ccfccebbea724eca8909be4fea93a58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:06.641852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-967dbc36-a69f-4382-883f-1e17f69a573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:06.649701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0191e7-f2ce-4076-bb9f-7928081954a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:06.651049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0191e7-f2ce-4076-bb9f-7928081954a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:06.651335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0191e7-f2ce-4076-bb9f-7928081954a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:06.651608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0191e7-f2ce-4076-bb9f-7928081954a2 admin admin] PATH_INFO: `/v3/projects/ad18cf7b097f46fba2afa9188709ca9d/users/809079de313f43538082b45bd13e6a61/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:06.655601 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0191e7-f2ce-4076-bb9f-7928081954a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad18cf7b097f46fba2afa9188709ca9d, user_id=809079de313f43538082b45bd13e6a61, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:06.661504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0191e7-f2ce-4076-bb9f-7928081954a2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:06.685909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 830/1671] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:06 2022] PUT /identity/v3/projects/ad18cf7b097f46fba2afa9188709ca9d/users/809079de313f43538082b45bd13e6a61/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:06.846826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 842/1672] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:06.848668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb02a-67ea-4f00-88f0-7458f9130de3 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:06.848957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb02a-67ea-4f00-88f0-7458f9130de3 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:06.849245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfb02a-67ea-4f00-88f0-7458f9130de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:06.887281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4ebfb02a-67ea-4f00-88f0-7458f9130de3 None None] MFA Rules not processed for user `ccfccebbea724eca8909be4fea93a58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:06.889208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4ebfb02a-67ea-4f00-88f0-7458f9130de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:07.031279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71cce0-21fd-46a4-958a-e5abf909f703 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:07.031569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71cce0-21fd-46a4-958a-e5abf909f703 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:07.031855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71cce0-21fd-46a4-958a-e5abf909f703 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:07.033367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 843/1673] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 23 17:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:12:07.058041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ed88-b9af-4b42-9877-bd44c87cc122 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:07.058348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ed88-b9af-4b42-9877-bd44c87cc122 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:07.058667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ed88-b9af-4b42-9877-bd44c87cc122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:07.062622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 831/1674] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:07.075783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb02a-67ea-4f00-88f0-7458f9130de3 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:07.159208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bc54ed88-b9af-4b42-9877-bd44c87cc122 None None] MFA Rules not processed for user `2a92136d53514159a22faacb60ef0c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:07.162320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bc54ed88-b9af-4b42-9877-bd44c87cc122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:07.244956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfb02a-67ea-4f00-88f0-7458f9130de3 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:07.254777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8899b1f-2550-4d50-884f-e2862c5056d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:07.255677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899b1f-2550-4d50-884f-e2862c5056d5 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:07.256175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899b1f-2550-4d50-884f-e2862c5056d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:07.256545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8899b1f-2550-4d50-884f-e2862c5056d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:07.276943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8899b1f-2550-4d50-884f-e2862c5056d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:07.279735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8899b1f-2550-4d50-884f-e2862c5056d5 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:07.305021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 832/1675] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:07.348668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 844/1676] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:07.426614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8899b1f-2550-4d50-884f-e2862c5056d5 service nova] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:07.449357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8899b1f-2550-4d50-884f-e2862c5056d5 service nova] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:07.473829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01dc3-7f63-43a7-a554-3deaf852f82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:07.474451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01dc3-7f63-43a7-a554-3deaf852f82e service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:07.474730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01dc3-7f63-43a7-a554-3deaf852f82e service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:07.474999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01dc3-7f63-43a7-a554-3deaf852f82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:07.497670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01dc3-7f63-43a7-a554-3deaf852f82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:07.500280 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01dc3-7f63-43a7-a554-3deaf852f82e service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:07.524218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 833/1677] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:07.891240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9fbaf-aee3-4ea0-809f-86ee7aa8f8eb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:07.891728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9fbaf-aee3-4ea0-809f-86ee7aa8f8eb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:07.891800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9fbaf-aee3-4ea0-809f-86ee7aa8f8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:07.929489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fee9fbaf-aee3-4ea0-809f-86ee7aa8f8eb None None] MFA Rules not processed for user `fc6a4d6c1f834720a69ee30d5ae63cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:07.934750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fee9fbaf-aee3-4ea0-809f-86ee7aa8f8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:08.043116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:08.072150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 845/1678] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:08.131424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03622-fc6a-4b19-9036-eb6c221e78c6 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:08.132020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03622-fc6a-4b19-9036-eb6c221e78c6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:08.132020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e03622-fc6a-4b19-9036-eb6c221e78c6 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:08.133680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 834/1679] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jun 23 17:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:12:08.141340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710aeb1-249e-467c-9dab-88e3803918d9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:08.141633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710aeb1-249e-467c-9dab-88e3803918d9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:08.141985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710aeb1-249e-467c-9dab-88e3803918d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:08.166162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c710aeb1-249e-467c-9dab-88e3803918d9 None None] MFA Rules not processed for user `2a92136d53514159a22faacb60ef0c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:08.167435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c710aeb1-249e-467c-9dab-88e3803918d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:08.175956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 846/1680] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:08.188705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e03622-fc6a-4b19-9036-eb6c221e78c6 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:08.191095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-08e03622-fc6a-4b19-9036-eb6c221e78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:08.217263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e03622-fc6a-4b19-9036-eb6c221e78c6 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:08.234734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8e05c-cee2-4e31-8c3d-082657f805a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:08.235768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8e05c-cee2-4e31-8c3d-082657f805a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:08.236361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8e05c-cee2-4e31-8c3d-082657f805a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:08.236675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8e05c-cee2-4e31-8c3d-082657f805a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:08.273472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8e05c-cee2-4e31-8c3d-082657f805a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:08.276745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8e05c-cee2-4e31-8c3d-082657f805a1 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:08.305690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 835/1681] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:08.480043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9df09c-74d1-44d4-a9a8-4383229d3ed1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:08.481096 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9df09c-74d1-44d4-a9a8-4383229d3ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:08.481693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9df09c-74d1-44d4-a9a8-4383229d3ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:08.549335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-dc9df09c-74d1-44d4-a9a8-4383229d3ed1 None None] MFA Rules not processed for user `809079de313f43538082b45bd13e6a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:08.553348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dc9df09c-74d1-44d4-a9a8-4383229d3ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:08.746142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 847/1682] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:08.893119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b408d-b268-4c07-a054-0bcadc4a9785 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:08.893812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b408d-b268-4c07-a054-0bcadc4a9785 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:08.894094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b408d-b268-4c07-a054-0bcadc4a9785 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:08.896802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 836/1683] 10.222.0.18 () {54 vars in 960 bytes} [Thu Jun 23 17:12:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:12:08.908654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df98a1-1377-4c74-a266-198faa1a528f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:08.909396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df98a1-1377-4c74-a266-198faa1a528f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:08.909396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df98a1-1377-4c74-a266-198faa1a528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:08.970147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-48df98a1-1377-4c74-a266-198faa1a528f None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:08.972643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-48df98a1-1377-4c74-a266-198faa1a528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:09.123150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 848/1684] 10.222.0.18 () {58 vars in 1057 bytes} [Thu Jun 23 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:09.138975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b408d-b268-4c07-a054-0bcadc4a9785 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:09.183686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b408d-b268-4c07-a054-0bcadc4a9785 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:09.195895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3fd63-fa1a-4407-aa8e-228f2500b685 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:09.196490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3fd63-fa1a-4407-aa8e-228f2500b685 service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:09.196755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3fd63-fa1a-4407-aa8e-228f2500b685 service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:09.197032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3fd63-fa1a-4407-aa8e-228f2500b685 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:09.199076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9ca3fd63-fa1a-4407-aa8e-228f2500b685 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:09.219872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3fd63-fa1a-4407-aa8e-228f2500b685 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:09.223703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3fd63-fa1a-4407-aa8e-228f2500b685 service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:09.297920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 837/1685] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:09.646044 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649b2c5-3df2-49ec-83f1-5b485ab01a51 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:09.646581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649b2c5-3df2-49ec-83f1-5b485ab01a51 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:09.646873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649b2c5-3df2-49ec-83f1-5b485ab01a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:09.701407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8649b2c5-3df2-49ec-83f1-5b485ab01a51 None None] MFA Rules not processed for user `ccfccebbea724eca8909be4fea93a58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:09.702820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8649b2c5-3df2-49ec-83f1-5b485ab01a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:09.713755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 849/1686] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:10.770949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f8eed-ce57-43d1-a896-302160c85104 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:10.773430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f8eed-ce57-43d1-a896-302160c85104 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:10.773907 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f8eed-ce57-43d1-a896-302160c85104 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:10.775779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 838/1687] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:12:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:12:10.920788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cda6e-402f-45e3-a36c-ae8220aeaf23 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:10.921592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cda6e-402f-45e3-a36c-ae8220aeaf23 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:10.921592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cda6e-402f-45e3-a36c-ae8220aeaf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:10.975947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-541cda6e-402f-45e3-a36c-ae8220aeaf23 None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:10.977417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-541cda6e-402f-45e3-a36c-ae8220aeaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:11.033041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 850/1688] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:12:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:11.157935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f8eed-ce57-43d1-a896-302160c85104 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:11.161712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-dd5f8eed-ce57-43d1-a896-302160c85104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:11.203042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f8eed-ce57-43d1-a896-302160c85104 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:11.214758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256593e-b4a1-4e5e-996a-6dd70b1fa74c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:11.215922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256593e-b4a1-4e5e-996a-6dd70b1fa74c service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:11.216410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256593e-b4a1-4e5e-996a-6dd70b1fa74c service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:11.217186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256593e-b4a1-4e5e-996a-6dd70b1fa74c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:11.232417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256593e-b4a1-4e5e-996a-6dd70b1fa74c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:11.246292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256593e-b4a1-4e5e-996a-6dd70b1fa74c service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:11.297043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 839/1689] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:11.624345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cda6e-402f-45e3-a36c-ae8220aeaf23 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:11.626105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-541cda6e-402f-45e3-a36c-ae8220aeaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:11.737011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:11.750549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cda6e-402f-45e3-a36c-ae8220aeaf23 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:11.762512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:11.763818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:11.764961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:11.765444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] PATH_INFO: `/v3/users/9e927e4ed8f44d4ca6e6be1b1386f403` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:11.768677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e927e4ed8f44d4ca6e6be1b1386f403)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:11.773492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:11.890257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e927e4ed8f44d4ca6e6be1b1386f403'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:11.891173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e927e4ed8f44d4ca6e6be1b1386f403'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:11.906200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e927e4ed8f44d4ca6e6be1b1386f403'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:11.924713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e927e4ed8f44d4ca6e6be1b1386f403'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:11.966327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e927e4ed8f44d4ca6e6be1b1386f403'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:12.000996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 851/1690] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:11 2022] DELETE /identity/v3/users/9e927e4ed8f44d4ca6e6be1b1386f403 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:12.005577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf8903-1fdb-49eb-b54e-650feaa5cdff None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:12.006124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf8903-1fdb-49eb-b54e-650feaa5cdff None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:12.006227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf8903-1fdb-49eb-b54e-650feaa5cdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:12.053103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a9bf8903-1fdb-49eb-b54e-650feaa5cdff None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:12.069691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a9bf8903-1fdb-49eb-b54e-650feaa5cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:12.081045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:12.290775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 840/1691] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:12.300809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:12.302624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:12.475017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c071b25-5e10-4722-b301-014305255062 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:12.488429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf541a5-a097-4f23-a266-66152d4b5163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:12.489394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf541a5-a097-4f23-a266-66152d4b5163 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:12.490083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf541a5-a097-4f23-a266-66152d4b5163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:12.490528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf541a5-a097-4f23-a266-66152d4b5163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:12.511909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf541a5-a097-4f23-a266-66152d4b5163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:12.515422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf541a5-a097-4f23-a266-66152d4b5163 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:12.542546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 852/1692] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:12.660196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3875d-fffd-4d9d-bfe9-f9c823122c25 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:12.660492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3875d-fffd-4d9d-bfe9-f9c823122c25 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:12.660761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3875d-fffd-4d9d-bfe9-f9c823122c25 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:12.663211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 841/1693] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:12:12.692313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd54d3-1212-4202-81a6-5e2bd8b750aa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:12.692620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd54d3-1212-4202-81a6-5e2bd8b750aa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:12.692900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd54d3-1212-4202-81a6-5e2bd8b750aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:12.731762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-59bd54d3-1212-4202-81a6-5e2bd8b750aa None None] MFA Rules not processed for user `067f71d863f7472eba2f5e9d04ae350e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:12.733195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-59bd54d3-1212-4202-81a6-5e2bd8b750aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:12.797722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3875d-fffd-4d9d-bfe9-f9c823122c25 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:12.799630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-58e3875d-fffd-4d9d-bfe9-f9c823122c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:12.844625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3875d-fffd-4d9d-bfe9-f9c823122c25 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:12.866875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:12.870270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:12.870805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:12.871279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] PATH_INFO: `/v3/users/38ed2481dd7b45c69593b1f3174c2c17` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:12.873680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ed2481dd7b45c69593b1f3174c2c17)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:12.876659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:12.963361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 853/1694] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:12.965697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd54d3-1212-4202-81a6-5e2bd8b750aa None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:12.972095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-59bd54d3-1212-4202-81a6-5e2bd8b750aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:13.016487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd54d3-1212-4202-81a6-5e2bd8b750aa None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:13.046364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ed2481dd7b45c69593b1f3174c2c17'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.073294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:13.077698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:13.078077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:13.079107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] PATH_INFO: `/v3/users/31b76cf6b35d49dfad1dfbd90b66cd58` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:13.079471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ed2481dd7b45c69593b1f3174c2c17'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.082841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b76cf6b35d49dfad1dfbd90b66cd58)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:13.088113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:13.129471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:13.136929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ed2481dd7b45c69593b1f3174c2c17'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.173534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ed2481dd7b45c69593b1f3174c2c17'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.177929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ed2481dd7b45c69593b1f3174c2c17'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.209617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 842/1695] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:12 2022] DELETE /identity/v3/users/38ed2481dd7b45c69593b1f3174c2c17 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:13.212265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:13.223293 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b76cf6b35d49dfad1dfbd90b66cd58'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.226851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b76cf6b35d49dfad1dfbd90b66cd58'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.246542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b76cf6b35d49dfad1dfbd90b66cd58'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.252974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:13.260510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b76cf6b35d49dfad1dfbd90b66cd58'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.339281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8bb9b6bc-6806-40fb-ace0-0a06967b6d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b76cf6b35d49dfad1dfbd90b66cd58'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:13.371200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 854/1696] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:12 2022] DELETE /identity/v3/users/31b76cf6b35d49dfad1dfbd90b66cd58 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:13.372682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31d3a-a50b-41a2-8894-2c33cfa5c60a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:13.372978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31d3a-a50b-41a2-8894-2c33cfa5c60a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:13.373247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31d3a-a50b-41a2-8894-2c33cfa5c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:13.433186 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d3d31d3a-a50b-41a2-8894-2c33cfa5c60a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:13.435821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d3d31d3a-a50b-41a2-8894-2c33cfa5c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:13.638919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9fc6e-bf1a-41f8-ab0d-f7c45a6005e4 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:13.706541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:13.766733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 855/1697] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:13.768565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d31d3a-a50b-41a2-8894-2c33cfa5c60a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:13.777645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d3d31d3a-a50b-41a2-8894-2c33cfa5c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:13.819357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d31d3a-a50b-41a2-8894-2c33cfa5c60a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:13.838610 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:13.839713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:13.840173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:13.840594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] PATH_INFO: `/v3/projects/adfd0d8dbe0e4b58a0d4d814493f0bb6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:13.847248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfd0d8dbe0e4b58a0d4d814493f0bb6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:13.849630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:13.894886 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:13.895585 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:13.895873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:13.896149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:13.906034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:13.983890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:13.988461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:14.015381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfd0d8dbe0e4b58a0d4d814493f0bb6', 'request_id': 'req-b12dfde7-746c-4bf9-a3f1-368138ac7e42'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.016249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfd0d8dbe0e4b58a0d4d814493f0bb6', 'request_id': 'req-b12dfde7-746c-4bf9-a3f1-368138ac7e42'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.020526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 843/1698] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:14.021644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:14.026076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfd0d8dbe0e4b58a0d4d814493f0bb6', 'request_id': 'req-b12dfde7-746c-4bf9-a3f1-368138ac7e42'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.032336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:14.055015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] The token cache is being invalidate because project adfd0d8dbe0e4b58a0d4d814493f0bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:14.059271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.065660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.072972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 856/1699] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:13 2022] DELETE /identity/v3/projects/adfd0d8dbe0e4b58a0d4d814493f0bb6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:14.074825 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:14.079085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:14.134632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:14.162032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba8d18-3118-4b3a-be35-34ad7c79ee9c service placement] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:14.297273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dfde7-746c-4bf9-a3f1-368138ac7e42 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:14.317507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:14.330498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:14.333086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:14.334948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] PATH_INFO: `/v3/users/e2965bdb5e1642e68942286d4f095ec2` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:14.336876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2965bdb5e1642e68942286d4f095ec2)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:14.339992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:14.402018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:14.403219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:14.403513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:14.403787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:14.407465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:14.448913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2965bdb5e1642e68942286d4f095ec2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.450827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2965bdb5e1642e68942286d4f095ec2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.460875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:14.470949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:14.490881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2965bdb5e1642e68942286d4f095ec2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.510162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 844/1700] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:14.511538 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:14.515631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:14.527478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2965bdb5e1642e68942286d4f095ec2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.548881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b9819-7786-4704-971a-24acb376adde service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:14.565628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:14.567168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:14.567663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:14.568247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] PATH_INFO: `/v3/projects/f2eb7c36aad74f838fca3c5fffb2676c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:14.571656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2eb7c36aad74f838fca3c5fffb2676c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:14.574256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:14.605537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-366d0950-10c7-433d-8db0-095c84877381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2965bdb5e1642e68942286d4f095ec2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.631370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 857/1701] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:14 2022] DELETE /identity/v3/users/e2965bdb5e1642e68942286d4f095ec2 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:14.632481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102e62d-418c-497a-9b47-5f3b25cd5dd5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:14.632792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102e62d-418c-497a-9b47-5f3b25cd5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:14.633079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102e62d-418c-497a-9b47-5f3b25cd5dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:14.694393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2102e62d-418c-497a-9b47-5f3b25cd5dd5 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:14.696328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2102e62d-418c-497a-9b47-5f3b25cd5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:14.772193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2eb7c36aad74f838fca3c5fffb2676c', 'request_id': 'req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.790646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2eb7c36aad74f838fca3c5fffb2676c', 'request_id': 'req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.834562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2eb7c36aad74f838fca3c5fffb2676c', 'request_id': 'req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.845998 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:14.855995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 858/1702] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:12:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:14.888014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] The token cache is being invalidate because project f2eb7c36aad74f838fca3c5fffb2676c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:14.888376 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.889695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:14.891343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 845/1703] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:14 2022] DELETE /identity/v3/projects/f2eb7c36aad74f838fca3c5fffb2676c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:14.895773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102e62d-418c-497a-9b47-5f3b25cd5dd5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:14.897634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2102e62d-418c-497a-9b47-5f3b25cd5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:14.983351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:15.055456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102e62d-418c-497a-9b47-5f3b25cd5dd5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:15.161411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:15.163221 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:15.196964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:15.198071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:15.198482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:15.198837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] PATH_INFO: `/v3/users/809079de313f43538082b45bd13e6a61` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:15.200694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=809079de313f43538082b45bd13e6a61)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:15.203408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:15.340409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809079de313f43538082b45bd13e6a61'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:15.342862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809079de313f43538082b45bd13e6a61'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:15.358309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809079de313f43538082b45bd13e6a61'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:15.368677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f32cc7-b7ad-4dfd-b6a0-65e0c48f1d8e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:15.375684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839105c-6ccc-457a-9ccb-3a634333dac1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:15.376848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839105c-6ccc-457a-9ccb-3a634333dac1 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:15.377246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839105c-6ccc-457a-9ccb-3a634333dac1 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:15.377780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839105c-6ccc-457a-9ccb-3a634333dac1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:15.382699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809079de313f43538082b45bd13e6a61'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:15.383656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2839105c-6ccc-457a-9ccb-3a634333dac1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:15.437361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809079de313f43538082b45bd13e6a61'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:15.455562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 859/1704] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:14 2022] DELETE /identity/v3/users/809079de313f43538082b45bd13e6a61 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:15.487905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839105c-6ccc-457a-9ccb-3a634333dac1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:15.489704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839105c-6ccc-457a-9ccb-3a634333dac1 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:15.502073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 846/1705] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:12:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:12:16.512885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:16.515108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:16.683471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f12af2-9d97-476c-9274-4ab5795a6497 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:16.699197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:16.700274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:16.700615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:16.701133 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] PATH_INFO: `/v3/projects/ae4929b0a6cf47ae8424685c63b0e2e6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:16.704160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4929b0a6cf47ae8424685c63b0e2e6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:16.706410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:16.712918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:16.824254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4929b0a6cf47ae8424685c63b0e2e6', 'request_id': 'req-7eebbf3a-28fd-4d45-ad7e-74d329657d72'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:16.842891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4929b0a6cf47ae8424685c63b0e2e6', 'request_id': 'req-7eebbf3a-28fd-4d45-ad7e-74d329657d72'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:16.857713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4929b0a6cf47ae8424685c63b0e2e6', 'request_id': 'req-7eebbf3a-28fd-4d45-ad7e-74d329657d72'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:16.924550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] The token cache is being invalidate because project ae4929b0a6cf47ae8424685c63b0e2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:16.924847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:16.930292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7eebbf3a-28fd-4d45-ad7e-74d329657d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:16.940742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 860/1706] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:16 2022] DELETE /identity/v3/projects/ae4929b0a6cf47ae8424685c63b0e2e6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:16.943151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee801d1-7e16-4d35-adc4-57eae6d395ed None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:16.943796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee801d1-7e16-4d35-adc4-57eae6d395ed None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:16.943877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee801d1-7e16-4d35-adc4-57eae6d395ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:17.008960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9ee801d1-7e16-4d35-adc4-57eae6d395ed None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:17.012696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9ee801d1-7e16-4d35-adc4-57eae6d395ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:17.266873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 847/1707] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:17.276085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619bfd3-ca7a-45f8-8f5a-4cf968a9de42 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:17.276514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619bfd3-ca7a-45f8-8f5a-4cf968a9de42 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:17.277478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619bfd3-ca7a-45f8-8f5a-4cf968a9de42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:17.322885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7619bfd3-ca7a-45f8-8f5a-4cf968a9de42 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:17.324402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7619bfd3-ca7a-45f8-8f5a-4cf968a9de42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:17.366687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 861/1708] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:17.367901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee801d1-7e16-4d35-adc4-57eae6d395ed None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:17.387476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee801d1-7e16-4d35-adc4-57eae6d395ed None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:17.403644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:17.407206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:17.408502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:17.410982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:17.412484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:17.412484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:17.413842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:17.456986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 848/1709] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:12:17.459043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619bfd3-ca7a-45f8-8f5a-4cf968a9de42 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:17.474104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619bfd3-ca7a-45f8-8f5a-4cf968a9de42 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:17.491484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24091090-f8ad-49c0-9025-30fd06dc9ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:17.492190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24091090-f8ad-49c0-9025-30fd06dc9ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:17.492868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24091090-f8ad-49c0-9025-30fd06dc9ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:17.493006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24091090-f8ad-49c0-9025-30fd06dc9ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:17.493679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24091090-f8ad-49c0-9025-30fd06dc9ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:17.495665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24091090-f8ad-49c0-9025-30fd06dc9ff8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:17.563075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:17.565549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:17.576000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 862/1710] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:17 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:17.589577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24091090-f8ad-49c0-9025-30fd06dc9ff8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:17.601857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f5b01-3c00-455d-b02e-814d7cddd28a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:17.684962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:17.743847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24091090-f8ad-49c0-9025-30fd06dc9ff8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:17.751517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:17.752685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:17.753220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:17.753943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:17.754896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:17.758745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:17.794884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 863/1711] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:17 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:17.796782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:17.799901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:17.810497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:17.811388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:17.811670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:17.819441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] PATH_INFO: `/v3/projects/ad18cf7b097f46fba2afa9188709ca9d` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:17.823683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad18cf7b097f46fba2afa9188709ca9d)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:17.827074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:17.842239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b4b8f-c1dd-4465-ac70-90f8e2914230 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:17.849532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:17.850819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:17.851319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:17.852608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] PATH_INFO: `/v3/projects/52cfe4503b6f40779e8b9370380036e5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:17.854610 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cfe4503b6f40779e8b9370380036e5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:17.857611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:17.940559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:17.943403 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cfe4503b6f40779e8b9370380036e5', 'request_id': 'req-cc1cbeda-2976-440b-99e4-e79ee6f0c127'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:17.953600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cfe4503b6f40779e8b9370380036e5', 'request_id': 'req-cc1cbeda-2976-440b-99e4-e79ee6f0c127'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:17.965171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cfe4503b6f40779e8b9370380036e5', 'request_id': 'req-cc1cbeda-2976-440b-99e4-e79ee6f0c127'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:17.987902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] The token cache is being invalidate because project 52cfe4503b6f40779e8b9370380036e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:17.988692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:17.991010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:17.997344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 864/1712] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:17 2022] DELETE /identity/v3/projects/52cfe4503b6f40779e8b9370380036e5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:18.001943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:18.007044 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:18.025628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad18cf7b097f46fba2afa9188709ca9d', 'request_id': 'req-6f1b777b-4c83-47ea-a948-aa838404fb62'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:18.047476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad18cf7b097f46fba2afa9188709ca9d', 'request_id': 'req-6f1b777b-4c83-47ea-a948-aa838404fb62'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:18.081424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad18cf7b097f46fba2afa9188709ca9d', 'request_id': 'req-6f1b777b-4c83-47ea-a948-aa838404fb62'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:18.119176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] The token cache is being invalidate because project ad18cf7b097f46fba2afa9188709ca9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:18.119498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:18.121565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f1b777b-4c83-47ea-a948-aa838404fb62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:18.130834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 849/1713] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:17 2022] DELETE /identity/v3/projects/ad18cf7b097f46fba2afa9188709ca9d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:18.133345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8f64-8a7f-4ff0-9f5d-0a334d0ef2e1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.136341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8f64-8a7f-4ff0-9f5d-0a334d0ef2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.138497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8f64-8a7f-4ff0-9f5d-0a334d0ef2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.182458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cbeda-2976-440b-99e4-e79ee6f0c127 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:18.227059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4c5b8f64-8a7f-4ff0-9f5d-0a334d0ef2e1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:18.230371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4c5b8f64-8a7f-4ff0-9f5d-0a334d0ef2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:18.446953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a7b14-fbeb-4f9b-92e0-b3f8882fc9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:18.449291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7b14-fbeb-4f9b-92e0-b3f8882fc9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.451866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7b14-fbeb-4f9b-92e0-b3f8882fc9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.453654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7b14-fbeb-4f9b-92e0-b3f8882fc9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.454899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a7b14-fbeb-4f9b-92e0-b3f8882fc9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:18.462329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a7b14-fbeb-4f9b-92e0-b3f8882fc9c1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:18.498205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 865/1714] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:18.503237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf96d9-11a1-4871-b5e3-337f7e6ad11f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.505111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf96d9-11a1-4871-b5e3-337f7e6ad11f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.506464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf96d9-11a1-4871-b5e3-337f7e6ad11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.517567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 850/1715] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:18.528087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b8f64-8a7f-4ff0-9f5d-0a334d0ef2e1 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:18.532133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4c5b8f64-8a7f-4ff0-9f5d-0a334d0ef2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:18.555053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-faaf96d9-11a1-4871-b5e3-337f7e6ad11f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:18.557120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-faaf96d9-11a1-4871-b5e3-337f7e6ad11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:18.569422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 866/1716] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:18.572047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d2af-0c75-4a76-9090-2fb4212072e0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.572784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d2af-0c75-4a76-9090-2fb4212072e0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.573733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7d2af-0c75-4a76-9090-2fb4212072e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.582330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b8f64-8a7f-4ff0-9f5d-0a334d0ef2e1 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:18.589316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:18.590796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.591151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.591618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.592540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:18.594542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:18.609667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 851/1717] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:18.611001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:18.614973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:18.641387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0df7d2af-0c75-4a76-9090-2fb4212072e0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:18.643632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0df7d2af-0c75-4a76-9090-2fb4212072e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:18.661864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 867/1718] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:18.663930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7ce3-ef1a-44d8-bd8a-53116ad760d3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.664359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7ce3-ef1a-44d8-bd8a-53116ad760d3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.664892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7ce3-ef1a-44d8-bd8a-53116ad760d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.671868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191258-1924-4616-8bd2-e30fb5332129 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:18.701189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:18.705036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.713731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.716324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] PATH_INFO: `/v3/users/c2d16c6da5e34d239b834532fd174fc3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.717307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a9bc7ce3-ef1a-44d8-bd8a-53116ad760d3 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:18.719351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a9bc7ce3-ef1a-44d8-bd8a-53116ad760d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:18.721994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d16c6da5e34d239b834532fd174fc3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:18.724253 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:18.730620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 868/1719] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:18.732226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc7ce3-ef1a-44d8-bd8a-53116ad760d3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:18.745306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc7ce3-ef1a-44d8-bd8a-53116ad760d3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:18.751329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64260d9-3fda-454e-a7be-e671bfe514f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:18.754222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64260d9-3fda-454e-a7be-e671bfe514f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.754680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64260d9-3fda-454e-a7be-e671bfe514f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.754967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64260d9-3fda-454e-a7be-e671bfe514f2 admin admin] PATH_INFO: `/v3/projects/9bab30797572474dbe2bcf13d7e3d0c8/users/b32fad15941d43dc9ef19d7dea8bea8f/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.796070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64260d9-3fda-454e-a7be-e671bfe514f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bab30797572474dbe2bcf13d7e3d0c8, user_id=b32fad15941d43dc9ef19d7dea8bea8f, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:18.804826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64260d9-3fda-454e-a7be-e671bfe514f2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:18.844521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 869/1720] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:18 2022] PUT /identity/v3/projects/9bab30797572474dbe2bcf13d7e3d0c8/users/b32fad15941d43dc9ef19d7dea8bea8f/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:18.867105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201baa0-c525-45c6-9bc4-ee01bf7af801 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:18.867660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201baa0-c525-45c6-9bc4-ee01bf7af801 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:18.867955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201baa0-c525-45c6-9bc4-ee01bf7af801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:18.927365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f201baa0-c525-45c6-9bc4-ee01bf7af801 None None] MFA Rules not processed for user `2a92136d53514159a22faacb60ef0c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:18.928911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f201baa0-c525-45c6-9bc4-ee01bf7af801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:18.932731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:18.954336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d16c6da5e34d239b834532fd174fc3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:18.974358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d16c6da5e34d239b834532fd174fc3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:18.990716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:19.013634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d16c6da5e34d239b834532fd174fc3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:19.026566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d16c6da5e34d239b834532fd174fc3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:19.027971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d16c6da5e34d239b834532fd174fc3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:19.035570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 852/1721] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:18 2022] DELETE /identity/v3/users/c2d16c6da5e34d239b834532fd174fc3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:19.037039 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:19.039569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:19.084376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 870/1722] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jun 23 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:19.085688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201baa0-c525-45c6-9bc4-ee01bf7af801 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:19.095905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f201baa0-c525-45c6-9bc4-ee01bf7af801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:19.275174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327342d0-455d-4654-ba70-b555d8b4a360 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:19.289114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180e807-af7b-4cf9-b338-5440d0660a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:19.294409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180e807-af7b-4cf9-b338-5440d0660a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:19.300465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180e807-af7b-4cf9-b338-5440d0660a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:19.301098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180e807-af7b-4cf9-b338-5440d0660a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:19.302194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180e807-af7b-4cf9-b338-5440d0660a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:19.303489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180e807-af7b-4cf9-b338-5440d0660a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:19.314520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180e807-af7b-4cf9-b338-5440d0660a0d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:19.334682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201baa0-c525-45c6-9bc4-ee01bf7af801 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:19.362572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae278a0-8a55-4943-9eac-534751760efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:19.363394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae278a0-8a55-4943-9eac-534751760efb admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:19.363773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae278a0-8a55-4943-9eac-534751760efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:19.364202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae278a0-8a55-4943-9eac-534751760efb admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:19.365077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae278a0-8a55-4943-9eac-534751760efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:19.365451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae278a0-8a55-4943-9eac-534751760efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:19.368178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 853/1723] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:19.372837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02255b6-1e39-42c3-8008-c2c5992ada05 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:19.375986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae278a0-8a55-4943-9eac-534751760efb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:19.379728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02255b6-1e39-42c3-8008-c2c5992ada05 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:19.380197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02255b6-1e39-42c3-8008-c2c5992ada05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:19.418434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 871/1724] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:19.420041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494cee-b89d-407e-bcd2-96fa28eaa549 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:19.423736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494cee-b89d-407e-bcd2-96fa28eaa549 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:19.424521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494cee-b89d-407e-bcd2-96fa28eaa549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:19.475953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a02255b6-1e39-42c3-8008-c2c5992ada05 None None] MFA Rules not processed for user `b32fad15941d43dc9ef19d7dea8bea8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:19.477556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a02255b6-1e39-42c3-8008-c2c5992ada05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:19.500172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e3494cee-b89d-407e-bcd2-96fa28eaa549 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:19.501734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e3494cee-b89d-407e-bcd2-96fa28eaa549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:19.532104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 872/1725] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:19.534352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3494cee-b89d-407e-bcd2-96fa28eaa549 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:19.537837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e3494cee-b89d-407e-bcd2-96fa28eaa549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:19.659116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 854/1726] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:19.660216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02255b6-1e39-42c3-8008-c2c5992ada05 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:19.702652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02255b6-1e39-42c3-8008-c2c5992ada05 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:19.709233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bab6e-fa7b-40b0-a16d-fe41554cda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:19.710269 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bab6e-fa7b-40b0-a16d-fe41554cda85 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:19.710774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bab6e-fa7b-40b0-a16d-fe41554cda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:19.711684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bab6e-fa7b-40b0-a16d-fe41554cda85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:19.712492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bab6e-fa7b-40b0-a16d-fe41554cda85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:19.714832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bab6e-fa7b-40b0-a16d-fe41554cda85 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:19.714985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3494cee-b89d-407e-bcd2-96fa28eaa549 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:19.732345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c96d7-b6af-457b-bc4a-8235113a8968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:19.732345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c96d7-b6af-457b-bc4a-8235113a8968 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:19.732345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c96d7-b6af-457b-bc4a-8235113a8968 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:19.732345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c96d7-b6af-457b-bc4a-8235113a8968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:19.750645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c96d7-b6af-457b-bc4a-8235113a8968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:19.752322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c96d7-b6af-457b-bc4a-8235113a8968 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:19.763986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 855/1727] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:19 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:19.764717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bab6e-fa7b-40b0-a16d-fe41554cda85 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:19.773858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 873/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:19.774592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c96d7-b6af-457b-bc4a-8235113a8968 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:19.794246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c96d7-b6af-457b-bc4a-8235113a8968 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:19.820133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:19.889399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bab6e-fa7b-40b0-a16d-fe41554cda85 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:19.899722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:19.900294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:19.900576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:19.901590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:19.902295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:19.904239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:19.928937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03636031-fa71-4793-9032-99b55a7e41ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:19.929859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03636031-fa71-4793-9032-99b55a7e41ea service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:19.930115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03636031-fa71-4793-9032-99b55a7e41ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:19.930575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03636031-fa71-4793-9032-99b55a7e41ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:19.951718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 856/1729] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:19 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:19.953324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:19.962172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:19.962505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03636031-fa71-4793-9032-99b55a7e41ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:19.973679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03636031-fa71-4793-9032-99b55a7e41ea service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.007637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 874/1730] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:20.008726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03636031-fa71-4793-9032-99b55a7e41ea service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.037582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03636031-fa71-4793-9032-99b55a7e41ea service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.071854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:20.150717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844ae6b-0e66-4807-a9e6-cc51189c1e49 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.164199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919d808-6025-44d6-b789-86277eade129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.166556 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919d808-6025-44d6-b789-86277eade129 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.168090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919d808-6025-44d6-b789-86277eade129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.169878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919d808-6025-44d6-b789-86277eade129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.170928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919d808-6025-44d6-b789-86277eade129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.178353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919d808-6025-44d6-b789-86277eade129 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.189098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29a3a1-da59-4736-9b16-03ce88754a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.190587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a3a1-da59-4736-9b16-03ce88754a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.190790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a3a1-da59-4736-9b16-03ce88754a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.195201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29a3a1-da59-4736-9b16-03ce88754a3e admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.195961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29a3a1-da59-4736-9b16-03ce88754a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.198343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29a3a1-da59-4736-9b16-03ce88754a3e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.238734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 857/1731] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:19 2022] POST /identity/v3/projects => generated 365 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:20.243088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919d808-6025-44d6-b789-86277eade129 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.262298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 875/1732] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:20 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:20.262298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29a3a1-da59-4736-9b16-03ce88754a3e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.290286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29a3a1-da59-4736-9b16-03ce88754a3e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.464046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919d808-6025-44d6-b789-86277eade129 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.471256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b6c28-06ad-4b8d-aa3e-314e80ebdb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.472346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6c28-06ad-4b8d-aa3e-314e80ebdb48 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.472755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6c28-06ad-4b8d-aa3e-314e80ebdb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.473035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6c28-06ad-4b8d-aa3e-314e80ebdb48 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.473955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b6c28-06ad-4b8d-aa3e-314e80ebdb48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.476324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b6c28-06ad-4b8d-aa3e-314e80ebdb48 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.482983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab135-7260-4281-8114-a212be9c94c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.485263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab135-7260-4281-8114-a212be9c94c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.485621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab135-7260-4281-8114-a212be9c94c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.488389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab135-7260-4281-8114-a212be9c94c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.490076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ab135-7260-4281-8114-a212be9c94c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.500817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ab135-7260-4281-8114-a212be9c94c0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.567961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 876/1733] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:20 2022] POST /identity/v3/users => generated 289 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:20.568786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab135-7260-4281-8114-a212be9c94c0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.577114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 858/1734] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:20 2022] POST /identity/v3/users => generated 286 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:20.578084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b6c28-06ad-4b8d-aa3e-314e80ebdb48 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.594890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab135-7260-4281-8114-a212be9c94c0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.623292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777fc90-278e-4e59-80d2-0a7fe314d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.624027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777fc90-278e-4e59-80d2-0a7fe314d665 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.624316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777fc90-278e-4e59-80d2-0a7fe314d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.624594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777fc90-278e-4e59-80d2-0a7fe314d665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.625346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777fc90-278e-4e59-80d2-0a7fe314d665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.627513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777fc90-278e-4e59-80d2-0a7fe314d665 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.651885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 877/1735] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:20.653167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777fc90-278e-4e59-80d2-0a7fe314d665 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.678943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777fc90-278e-4e59-80d2-0a7fe314d665 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.692258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac8602-564c-4f1c-a4dc-95e70a7d2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.693183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac8602-564c-4f1c-a4dc-95e70a7d2e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.693476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac8602-564c-4f1c-a4dc-95e70a7d2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.693750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac8602-564c-4f1c-a4dc-95e70a7d2e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.694527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac8602-564c-4f1c-a4dc-95e70a7d2e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.695239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b6c28-06ad-4b8d-aa3e-314e80ebdb48 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.696556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac8602-564c-4f1c-a4dc-95e70a7d2e40 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.733102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3b30b-5af4-4593-a5d6-fe10429d2e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.736820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3b30b-5af4-4593-a5d6-fe10429d2e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.737457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 878/1736] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:20.738458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac8602-564c-4f1c-a4dc-95e70a7d2e40 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.746354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3b30b-5af4-4593-a5d6-fe10429d2e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.751834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3b30b-5af4-4593-a5d6-fe10429d2e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.753073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3b30b-5af4-4593-a5d6-fe10429d2e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.760159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3b30b-5af4-4593-a5d6-fe10429d2e76 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.772998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac8602-564c-4f1c-a4dc-95e70a7d2e40 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.788946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e949-95c3-4503-9180-410549ee984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.789941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e949-95c3-4503-9180-410549ee984a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.790349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e949-95c3-4503-9180-410549ee984a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.790701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e949-95c3-4503-9180-410549ee984a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.791551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e949-95c3-4503-9180-410549ee984a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.795143 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e949-95c3-4503-9180-410549ee984a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.828532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 879/1737] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:20.829690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e949-95c3-4503-9180-410549ee984a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.853845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e949-95c3-4503-9180-410549ee984a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.855116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 859/1738] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:20.864436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3b30b-5af4-4593-a5d6-fe10429d2e76 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.876523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c40e5-aacc-4277-933c-6b0cb7a48cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.879483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c40e5-aacc-4277-933c-6b0cb7a48cac admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.879483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c40e5-aacc-4277-933c-6b0cb7a48cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.879483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c40e5-aacc-4277-933c-6b0cb7a48cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.882358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c40e5-aacc-4277-933c-6b0cb7a48cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:20.886807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c40e5-aacc-4277-933c-6b0cb7a48cac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:20.924955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3b30b-5af4-4593-a5d6-fe10429d2e76 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.932210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 880/1739] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:20.934226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c40e5-aacc-4277-933c-6b0cb7a48cac admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:20.956755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d089d2-bd5b-49a7-94cd-5caa7937f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.958060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d089d2-bd5b-49a7-94cd-5caa7937f40c admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.958405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d089d2-bd5b-49a7-94cd-5caa7937f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.958688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d089d2-bd5b-49a7-94cd-5caa7937f40c admin admin] PATH_INFO: `/v3/projects/29ecc99db76446599656891ad3860f44/users/c22a03f0719d4ddcbb95661878f184f2/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:20.962313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c40e5-aacc-4277-933c-6b0cb7a48cac admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:20.967049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:20.980164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83bd72-6e4e-411e-9814-86637743ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:20.983694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bd72-6e4e-411e-9814-86637743ea27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:20.984005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bd72-6e4e-411e-9814-86637743ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:20.984295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bd72-6e4e-411e-9814-86637743ea27 admin admin] PATH_INFO: `/v3/projects/57b2c9ed78d0410c9f5bf149e79edeed/users/e797291336194e219990756994a84787/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:21.029643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d089d2-bd5b-49a7-94cd-5caa7937f40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ecc99db76446599656891ad3860f44, user_id=c22a03f0719d4ddcbb95661878f184f2, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:21.033373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d089d2-bd5b-49a7-94cd-5caa7937f40c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:21.045837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83bd72-6e4e-411e-9814-86637743ea27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b2c9ed78d0410c9f5bf149e79edeed, user_id=e797291336194e219990756994a84787, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:21.053685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83bd72-6e4e-411e-9814-86637743ea27 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:21.067222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 860/1740] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:20 2022] PUT /identity/v3/projects/29ecc99db76446599656891ad3860f44/users/c22a03f0719d4ddcbb95661878f184f2/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:21.068357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d089d2-bd5b-49a7-94cd-5caa7937f40c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:21.092712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 881/1741] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:20 2022] PUT /identity/v3/projects/57b2c9ed78d0410c9f5bf149e79edeed/users/e797291336194e219990756994a84787/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:21.097753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f0f3-9041-4e8c-800d-7ad579a4adfd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:21.098076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f0f3-9041-4e8c-800d-7ad579a4adfd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:21.099845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f0f3-9041-4e8c-800d-7ad579a4adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:21.184632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cd47f0f3-9041-4e8c-800d-7ad579a4adfd None None] MFA Rules not processed for user `c22a03f0719d4ddcbb95661878f184f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:21.186849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cd47f0f3-9041-4e8c-800d-7ad579a4adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:21.191634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d089d2-bd5b-49a7-94cd-5caa7937f40c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:21.250641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:21.382359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb65de-b749-4a73-a96a-6d8b4ef952b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:21.383290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb65de-b749-4a73-a96a-6d8b4ef952b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:21.383682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb65de-b749-4a73-a96a-6d8b4ef952b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:21.383952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb65de-b749-4a73-a96a-6d8b4ef952b5 admin admin] PATH_INFO: `/v3/projects/705c41a0ba4d41179c23816cc5b82cd3/users/919fb1993a9f4e8699ac2a6c9a73d3bf/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:21.408062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb65de-b749-4a73-a96a-6d8b4ef952b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=705c41a0ba4d41179c23816cc5b82cd3, user_id=919fb1993a9f4e8699ac2a6c9a73d3bf, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:21.422958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb65de-b749-4a73-a96a-6d8b4ef952b5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:21.457570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 861/1742] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:21 2022] PUT /identity/v3/projects/705c41a0ba4d41179c23816cc5b82cd3/users/919fb1993a9f4e8699ac2a6c9a73d3bf/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:21.458690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb65de-b749-4a73-a96a-6d8b4ef952b5 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:21.467966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 882/1743] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:21.482719 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db197a22-6ecd-4a71-8141-d3b6d5905602 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:21.483038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db197a22-6ecd-4a71-8141-d3b6d5905602 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:21.483779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db197a22-6ecd-4a71-8141-d3b6d5905602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:21.570905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-db197a22-6ecd-4a71-8141-d3b6d5905602 None None] MFA Rules not processed for user `919fb1993a9f4e8699ac2a6c9a73d3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:21.572854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db197a22-6ecd-4a71-8141-d3b6d5905602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:21.664072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb65de-b749-4a73-a96a-6d8b4ef952b5 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:21.678700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae6bdd-5cf4-4457-80fd-5cc37a5edee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:21.679403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae6bdd-5cf4-4457-80fd-5cc37a5edee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:21.679690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae6bdd-5cf4-4457-80fd-5cc37a5edee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:21.679967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae6bdd-5cf4-4457-80fd-5cc37a5edee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:21.680812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae6bdd-5cf4-4457-80fd-5cc37a5edee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:21.682717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae6bdd-5cf4-4457-80fd-5cc37a5edee9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:21.706285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 862/1744] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:21.707050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae6bdd-5cf4-4457-80fd-5cc37a5edee9 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:21.744697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae6bdd-5cf4-4457-80fd-5cc37a5edee9 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:21.757086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7d63e-4b5a-4a65-88d7-bd5ab0b72a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:21.757815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d63e-4b5a-4a65-88d7-bd5ab0b72a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:21.758192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d63e-4b5a-4a65-88d7-bd5ab0b72a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:21.758520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d63e-4b5a-4a65-88d7-bd5ab0b72a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:21.759343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7d63e-4b5a-4a65-88d7-bd5ab0b72a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:21.761529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7d63e-4b5a-4a65-88d7-bd5ab0b72a8a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:21.781869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 883/1745] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:21.781869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db197a22-6ecd-4a71-8141-d3b6d5905602 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:21.795120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:21.795321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db197a22-6ecd-4a71-8141-d3b6d5905602 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:21.808171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba997ec-dea5-4e4e-8a83-c33ff820fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:21.809383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba997ec-dea5-4e4e-8a83-c33ff820fbba admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:21.809727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba997ec-dea5-4e4e-8a83-c33ff820fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:21.810304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba997ec-dea5-4e4e-8a83-c33ff820fbba admin admin] PATH_INFO: `/v3/projects/57b2c9ed78d0410c9f5bf149e79edeed/users/e797291336194e219990756994a84787/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:21.812934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba997ec-dea5-4e4e-8a83-c33ff820fbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b2c9ed78d0410c9f5bf149e79edeed, user_id=e797291336194e219990756994a84787, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:21.817060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba997ec-dea5-4e4e-8a83-c33ff820fbba admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:21.833031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 884/1746] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:21 2022] PUT /identity/v3/projects/57b2c9ed78d0410c9f5bf149e79edeed/users/e797291336194e219990756994a84787/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:21.834715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba997ec-dea5-4e4e-8a83-c33ff820fbba admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:21.917150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 863/1747] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:21 2022] POST /identity/v3/projects => generated 365 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:21.920663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550edf2d-945e-4bbd-9c48-c12debdf3126 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:21.921084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550edf2d-945e-4bbd-9c48-c12debdf3126 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:21.921379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550edf2d-945e-4bbd-9c48-c12debdf3126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:22.012073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-550edf2d-945e-4bbd-9c48-c12debdf3126 None None] MFA Rules not processed for user `e797291336194e219990756994a84787`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:22.016263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-550edf2d-945e-4bbd-9c48-c12debdf3126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:22.047637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba997ec-dea5-4e4e-8a83-c33ff820fbba admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:22.224630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:22.316514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 864/1748] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:22.317412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550edf2d-945e-4bbd-9c48-c12debdf3126 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:22.323738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:22.324447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:22.324716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:22.324990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:22.325700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:22.332893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:22.343626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550edf2d-945e-4bbd-9c48-c12debdf3126 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:22.359333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1823f34-8f58-4960-8690-505ea194a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:22.360031 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1823f34-8f58-4960-8690-505ea194a1fb admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:22.361389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1823f34-8f58-4960-8690-505ea194a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:22.361684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1823f34-8f58-4960-8690-505ea194a1fb admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:22.394063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1823f34-8f58-4960-8690-505ea194a1fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:22.402883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1823f34-8f58-4960-8690-505ea194a1fb admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:22.456713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 885/1749] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:21 2022] POST /identity/v3/projects => generated 373 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:22.457936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:22.464982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:22.483453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 865/1750] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:22 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:22.492246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1823f34-8f58-4960-8690-505ea194a1fb admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:22.541250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1823f34-8f58-4960-8690-505ea194a1fb admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:22.813617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef344a-1272-4492-8567-efa6fe8b635c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:22.830840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:22.834122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:22.835989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:22.837210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:22.871911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb59a6-34f4-4aa7-aeee-a6e53d4466fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:22.872627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb59a6-34f4-4aa7-aeee-a6e53d4466fa admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:22.872908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb59a6-34f4-4aa7-aeee-a6e53d4466fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:22.873180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb59a6-34f4-4aa7-aeee-a6e53d4466fa admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:22.873946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb59a6-34f4-4aa7-aeee-a6e53d4466fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:22.876055 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb59a6-34f4-4aa7-aeee-a6e53d4466fa admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:22.948911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 866/1751] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:22 2022] POST /identity/v3/users => generated 293 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:22.950313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb59a6-34f4-4aa7-aeee-a6e53d4466fa admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:22.977537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb59a6-34f4-4aa7-aeee-a6e53d4466fa admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:22.993542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbee38-44f5-4932-b885-d78f7ba09be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:22.994704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbee38-44f5-4932-b885-d78f7ba09be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:22.996014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbee38-44f5-4932-b885-d78f7ba09be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:22.996481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbee38-44f5-4932-b885-d78f7ba09be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:22.998410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbee38-44f5-4932-b885-d78f7ba09be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:23.002375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbee38-44f5-4932-b885-d78f7ba09be4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:23.039711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 867/1752] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:23.041170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbee38-44f5-4932-b885-d78f7ba09be4 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:23.063008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:23.066471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:23.084851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbee38-44f5-4932-b885-d78f7ba09be4 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:23.097786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919160-fd78-48be-862d-0b62ace696c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:23.098790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919160-fd78-48be-862d-0b62ace696c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:23.099559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919160-fd78-48be-862d-0b62ace696c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:23.099990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919160-fd78-48be-862d-0b62ace696c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:23.105135 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51919160-fd78-48be-862d-0b62ace696c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:23.106106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 886/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:23.107624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:23.110834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:23.111234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51919160-fd78-48be-862d-0b62ace696c4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:23.145208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 868/1754] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:23.146526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919160-fd78-48be-862d-0b62ace696c4 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:23.151350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a41689-e077-4038-a040-cedc8e4d9b3f service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:23.163205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:23.164057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:23.164340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:23.165487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] PATH_INFO: `/v3/projects/1078c824df3b4686b378082ba8ae56c7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:23.166058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1078c824df3b4686b378082ba8ae56c7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:23.171542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:23.176149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919160-fd78-48be-862d-0b62ace696c4 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:23.203060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659285-0a28-446f-9860-4bbaaf98aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:23.206082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659285-0a28-446f-9860-4bbaaf98aa5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:23.206372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659285-0a28-446f-9860-4bbaaf98aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:23.206655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659285-0a28-446f-9860-4bbaaf98aa5f admin admin] PATH_INFO: `/v3/projects/8951d66e7d7b48c08f36bb799c2f69b3/users/51c026a37a604f0d820cefbb4ea44624/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:23.260033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e659285-0a28-446f-9860-4bbaaf98aa5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8951d66e7d7b48c08f36bb799c2f69b3, user_id=51c026a37a604f0d820cefbb4ea44624, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:23.267844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e659285-0a28-446f-9860-4bbaaf98aa5f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:23.281003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1078c824df3b4686b378082ba8ae56c7', 'request_id': 'req-8a4190d1-d1c4-4077-810d-9f00267bc623'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:23.288671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:23.304503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1078c824df3b4686b378082ba8ae56c7', 'request_id': 'req-8a4190d1-d1c4-4077-810d-9f00267bc623'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:23.324070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 869/1755] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:23 2022] PUT /identity/v3/projects/8951d66e7d7b48c08f36bb799c2f69b3/users/51c026a37a604f0d820cefbb4ea44624/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:23.328071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659285-0a28-446f-9860-4bbaaf98aa5f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:23.344738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1078c824df3b4686b378082ba8ae56c7', 'request_id': 'req-8a4190d1-d1c4-4077-810d-9f00267bc623'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:23.374476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:23.394788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] The token cache is being invalidate because project 1078c824df3b4686b378082ba8ae56c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:23.395905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:23.397021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:23.407738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 887/1756] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:23 2022] DELETE /identity/v3/projects/1078c824df3b4686b378082ba8ae56c7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:23.410578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:23.416981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:23.498456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659285-0a28-446f-9860-4bbaaf98aa5f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:23.519043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad6e8b-9479-4d59-851d-e08b5f64e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:23.520184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6e8b-9479-4d59-851d-e08b5f64e796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:23.521313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6e8b-9479-4d59-851d-e08b5f64e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:23.521671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6e8b-9479-4d59-851d-e08b5f64e796 admin admin] PATH_INFO: `/v3/projects/861ce962b8a746deaa12b693a76f5e26/users/6eac5318240b441ab4be2d5574f32f40/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:23.557482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad6e8b-9479-4d59-851d-e08b5f64e796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861ce962b8a746deaa12b693a76f5e26, user_id=6eac5318240b441ab4be2d5574f32f40, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:23.580081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad6e8b-9479-4d59-851d-e08b5f64e796 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:23.608003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 870/1757] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:23 2022] PUT /identity/v3/projects/861ce962b8a746deaa12b693a76f5e26/users/6eac5318240b441ab4be2d5574f32f40/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:23.628615 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b93c-80c4-49af-903f-b429a6a4bd18 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:23.629243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b93c-80c4-49af-903f-b429a6a4bd18 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:23.635611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b93c-80c4-49af-903f-b429a6a4bd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:23.701010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4190d1-d1c4-4077-810d-9f00267bc623 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:23.707962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1d84b93c-80c4-49af-903f-b429a6a4bd18 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:23.713676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1d84b93c-80c4-49af-903f-b429a6a4bd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:23.949708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b89772-724c-48fc-a4a4-e65698dbd659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:23.950446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89772-724c-48fc-a4a4-e65698dbd659 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:23.950734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89772-724c-48fc-a4a4-e65698dbd659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:23.956033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89772-724c-48fc-a4a4-e65698dbd659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:23.962491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b89772-724c-48fc-a4a4-e65698dbd659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:23.964247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b89772-724c-48fc-a4a4-e65698dbd659 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:23.969377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 871/1758] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:23.987081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84b93c-80c4-49af-903f-b429a6a4bd18 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:23.996653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1d84b93c-80c4-49af-903f-b429a6a4bd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:24.020225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 888/1759] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 611 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:24.021516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7688-93df-4468-920c-c92c169fa51a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.021833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7688-93df-4468-920c-c92c169fa51a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.022125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7688-93df-4468-920c-c92c169fa51a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.025524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 889/1760] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:12:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:12:24.036303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e39a8-cef5-498c-9041-9b04095d8c0d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.036594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e39a8-cef5-498c-9041-9b04095d8c0d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.036877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e39a8-cef5-498c-9041-9b04095d8c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.040803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84b93c-80c4-49af-903f-b429a6a4bd18 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:24.055636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6b08-d9a1-4c62-8781-d4bc0946acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:24.056338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6b08-d9a1-4c62-8781-d4bc0946acf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.056643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6b08-d9a1-4c62-8781-d4bc0946acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.056901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6b08-d9a1-4c62-8781-d4bc0946acf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.057658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f6b08-d9a1-4c62-8781-d4bc0946acf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:24.059326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f6b08-d9a1-4c62-8781-d4bc0946acf9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:24.107020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-617e39a8-cef5-498c-9041-9b04095d8c0d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:24.108417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-617e39a8-cef5-498c-9041-9b04095d8c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:24.132419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 890/1761] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:24.133271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e39a8-cef5-498c-9041-9b04095d8c0d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:24.134554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 872/1762] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:24.141016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6b08-d9a1-4c62-8781-d4bc0946acf9 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:24.176247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e39a8-cef5-498c-9041-9b04095d8c0d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:24.191215 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6b08-d9a1-4c62-8781-d4bc0946acf9 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:24.195873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d838-d4f0-45cd-b9ac-90607a9ff7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:24.196807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d838-d4f0-45cd-b9ac-90607a9ff7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.197093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d838-d4f0-45cd-b9ac-90607a9ff7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.197373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d838-d4f0-45cd-b9ac-90607a9ff7c9 admin admin] PATH_INFO: `/v3/projects/8951d66e7d7b48c08f36bb799c2f69b3/users/51c026a37a604f0d820cefbb4ea44624/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.203766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d838-d4f0-45cd-b9ac-90607a9ff7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8951d66e7d7b48c08f36bb799c2f69b3, user_id=51c026a37a604f0d820cefbb4ea44624, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:24.203976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7873d-dd61-451c-a35a-f727472f5fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:24.208850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7873d-dd61-451c-a35a-f727472f5fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.210785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7873d-dd61-451c-a35a-f727472f5fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.216290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7873d-dd61-451c-a35a-f727472f5fe8 admin admin] PATH_INFO: `/v3/projects/861ce962b8a746deaa12b693a76f5e26/users/6eac5318240b441ab4be2d5574f32f40/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.217562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d838-d4f0-45cd-b9ac-90607a9ff7c9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:24.224037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7873d-dd61-451c-a35a-f727472f5fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861ce962b8a746deaa12b693a76f5e26, user_id=6eac5318240b441ab4be2d5574f32f40, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:24.232365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7873d-dd61-451c-a35a-f727472f5fe8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:24.278434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 891/1763] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:24 2022] PUT /identity/v3/projects/8951d66e7d7b48c08f36bb799c2f69b3/users/51c026a37a604f0d820cefbb4ea44624/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:24.284499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d838-d4f0-45cd-b9ac-90607a9ff7c9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:24.300782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 873/1764] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:24 2022] PUT /identity/v3/projects/861ce962b8a746deaa12b693a76f5e26/users/6eac5318240b441ab4be2d5574f32f40/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:24.316953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02b099-3a2b-4eaa-8b15-aee93d654b0f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.319823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02b099-3a2b-4eaa-8b15-aee93d654b0f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.320346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02b099-3a2b-4eaa-8b15-aee93d654b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.419927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-7b02b099-3a2b-4eaa-8b15-aee93d654b0f None None] MFA Rules not processed for user `51c026a37a604f0d820cefbb4ea44624`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:24.435786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-7b02b099-3a2b-4eaa-8b15-aee93d654b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:24.489114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d838-d4f0-45cd-b9ac-90607a9ff7c9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:24.553112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:24.592181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:24.626386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bb4a0-d11b-418d-b17c-7d060b3f45ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:24.629013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bb4a0-d11b-418d-b17c-7d060b3f45ce admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.629013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bb4a0-d11b-418d-b17c-7d060b3f45ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.629238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bb4a0-d11b-418d-b17c-7d060b3f45ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.632020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bb4a0-d11b-418d-b17c-7d060b3f45ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:24.632419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bb4a0-d11b-418d-b17c-7d060b3f45ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:24.637150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bb4a0-d11b-418d-b17c-7d060b3f45ce admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:24.662964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 874/1765] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:24.664428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 892/1766] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:24.665328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ab1b8-553e-4751-b62c-a9fefb99dcd4 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.665517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ab1b8-553e-4751-b62c-a9fefb99dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.665834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ab1b8-553e-4751-b62c-a9fefb99dcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.666195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82a4d-ad3c-48d9-83f9-ef16f16a1661 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.666492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82a4d-ad3c-48d9-83f9-ef16f16a1661 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.666774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82a4d-ad3c-48d9-83f9-ef16f16a1661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.731760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f34ab1b8-553e-4751-b62c-a9fefb99dcd4 None None] MFA Rules not processed for user `6eac5318240b441ab4be2d5574f32f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:24.733017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f34ab1b8-553e-4751-b62c-a9fefb99dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:24.743423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8eb82a4d-ad3c-48d9-83f9-ef16f16a1661 None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:24.748273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8eb82a4d-ad3c-48d9-83f9-ef16f16a1661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:24.907654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 875/1767] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:24.907654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ab1b8-553e-4751-b62c-a9fefb99dcd4 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:24.907654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f34ab1b8-553e-4751-b62c-a9fefb99dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:24.925878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 893/1768] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:24.928343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eb152-4a28-4014-a2f3-9875f0df7f14 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.928901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eb152-4a28-4014-a2f3-9875f0df7f14 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.929843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eb152-4a28-4014-a2f3-9875f0df7f14 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.933125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 894/1769] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:12:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:12:24.934394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eb152-4a28-4014-a2f3-9875f0df7f14 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:24.963627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ab1b8-553e-4751-b62c-a9fefb99dcd4 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:24.967930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eb152-4a28-4014-a2f3-9875f0df7f14 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:24.975582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:24.976514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.976799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.977076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] PATH_INFO: `/v3/users/b32fad15941d43dc9ef19d7dea8bea8f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.987407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:24.988283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:24.988626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:24.988957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:24.989715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:24.993449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32fad15941d43dc9ef19d7dea8bea8f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:24.996938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:25.005535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:25.113701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 895/1770] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:24 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:25.116666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:25.122699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:25.159713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32fad15941d43dc9ef19d7dea8bea8f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:25.183517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32fad15941d43dc9ef19d7dea8bea8f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:25.212444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32fad15941d43dc9ef19d7dea8bea8f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:25.237904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32fad15941d43dc9ef19d7dea8bea8f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:25.240127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32fad15941d43dc9ef19d7dea8bea8f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:25.249627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742275df-02e9-44ff-b144-39911bf11448 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:25.257502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 876/1771] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:24 2022] DELETE /identity/v3/users/b32fad15941d43dc9ef19d7dea8bea8f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:25.261496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:25.263366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:25.266293 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b61da-23d7-4973-b97c-d94b64ef2229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:25.267090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b61da-23d7-4973-b97c-d94b64ef2229 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:25.267476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b61da-23d7-4973-b97c-d94b64ef2229 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:25.267668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b61da-23d7-4973-b97c-d94b64ef2229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:25.270004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-608b61da-23d7-4973-b97c-d94b64ef2229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:25.370073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:25.418874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf23095-d390-46a7-be86-53f232d2c1c7 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:25.458344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:25.459895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:25.460407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:25.460892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:25.461154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:25.474553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:25.497221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b61da-23d7-4973-b97c-d94b64ef2229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:25.499130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b61da-23d7-4973-b97c-d94b64ef2229 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:25.528276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 896/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:25.530999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2cbe-e52c-45f2-8d2f-7b3e56c2c9e9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:25.531294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2cbe-e52c-45f2-8d2f-7b3e56c2c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:25.531579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2cbe-e52c-45f2-8d2f-7b3e56c2c9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:25.595847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-890d2cbe-e52c-45f2-8d2f-7b3e56c2c9e9 None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:25.603920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-890d2cbe-e52c-45f2-8d2f-7b3e56c2c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:25.748388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:25.763137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:25.788711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 877/1773] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:25.805209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:25.815691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:25.855913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 897/1774] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:12:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:25.860198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d2cbe-e52c-45f2-8d2f-7b3e56c2c9e9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:25.871105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-890d2cbe-e52c-45f2-8d2f-7b3e56c2c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:26.068590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071521-8945-47d2-96b0-4d7c6307db18 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:26.077834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f8d81-5a50-479e-b0c9-9f2eedcbecbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:26.078525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f8d81-5a50-479e-b0c9-9f2eedcbecbd service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.078833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f8d81-5a50-479e-b0c9-9f2eedcbecbd service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.079115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f8d81-5a50-479e-b0c9-9f2eedcbecbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.086960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-3c6f8d81-5a50-479e-b0c9-9f2eedcbecbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:26.106777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f8d81-5a50-479e-b0c9-9f2eedcbecbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:26.108486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f8d81-5a50-479e-b0c9-9f2eedcbecbd service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:26.121614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 878/1775] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:26.127944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d371e-e7db-490f-9a3d-a32dcc0a8869 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.128576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d371e-e7db-490f-9a3d-a32dcc0a8869 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.128576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d371e-e7db-490f-9a3d-a32dcc0a8869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.147998 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-df3d371e-e7db-490f-9a3d-a32dcc0a8869 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:26.148821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d2cbe-e52c-45f2-8d2f-7b3e56c2c9e9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:26.149326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-df3d371e-e7db-490f-9a3d-a32dcc0a8869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:26.161167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:26.164367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.166166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.166700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.169749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 879/1776] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:26.170252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:26.170925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d371e-e7db-490f-9a3d-a32dcc0a8869 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:26.177156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:26.181594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d371e-e7db-490f-9a3d-a32dcc0a8869 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:26.185371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:26.186510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.186798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.187102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.190352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:26.236110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 898/1777] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:25 2022] POST /identity/v3/users => generated 303 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:26.237142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:26.239633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:26.275201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:26.276664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:26.292366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 880/1778] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:26.293271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:26.305092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4682e-526a-436e-bcae-d0f4d96474c1 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:26.309969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb201e6-6600-4eff-a1ab-b82f65804787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:26.310671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb201e6-6600-4eff-a1ab-b82f65804787 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.310946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb201e6-6600-4eff-a1ab-b82f65804787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.311223 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb201e6-6600-4eff-a1ab-b82f65804787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.311966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb201e6-6600-4eff-a1ab-b82f65804787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:26.313865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb201e6-6600-4eff-a1ab-b82f65804787 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:26.316178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:26.333569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 881/1779] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:26.337862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb201e6-6600-4eff-a1ab-b82f65804787 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:26.350980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb201e6-6600-4eff-a1ab-b82f65804787 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:26.356952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96043785-329f-4574-aa0f-4592d004a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:26.357951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96043785-329f-4574-aa0f-4592d004a823 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.358536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96043785-329f-4574-aa0f-4592d004a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.359165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96043785-329f-4574-aa0f-4592d004a823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.360438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96043785-329f-4574-aa0f-4592d004a823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:26.362499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96043785-329f-4574-aa0f-4592d004a823 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:26.375947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 882/1780] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:26.382263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96043785-329f-4574-aa0f-4592d004a823 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:26.402052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96043785-329f-4574-aa0f-4592d004a823 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:26.408779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00d73a-ac2e-4b32-ac6d-b53380127948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:26.409464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebdb64-456b-487c-9f12-d8e3a20ef388 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:26.410498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00d73a-ac2e-4b32-ac6d-b53380127948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.410897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00d73a-ac2e-4b32-ac6d-b53380127948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.411540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00d73a-ac2e-4b32-ac6d-b53380127948 admin admin] PATH_INFO: `/v3/projects/4b5dd4c269074b7b8a0cee4e00350f38/users/f70cacc673594047afc2de30ae208617/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.440354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260d74a-622c-41ce-938a-213be96a0355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:26.443395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260d74a-622c-41ce-938a-213be96a0355 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.443832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260d74a-622c-41ce-938a-213be96a0355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.445582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260d74a-622c-41ce-938a-213be96a0355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.446066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00d73a-ac2e-4b32-ac6d-b53380127948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5dd4c269074b7b8a0cee4e00350f38, user_id=f70cacc673594047afc2de30ae208617, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:26.450962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00d73a-ac2e-4b32-ac6d-b53380127948 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:26.474732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260d74a-622c-41ce-938a-213be96a0355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:26.476261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260d74a-622c-41ce-938a-213be96a0355 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:26.495862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 883/1781] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:26 2022] PUT /identity/v3/projects/4b5dd4c269074b7b8a0cee4e00350f38/users/f70cacc673594047afc2de30ae208617/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:26.510647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc80e5e-eac5-4978-83f9-4a9e00b6c2cb None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.510943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc80e5e-eac5-4978-83f9-4a9e00b6c2cb None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.511281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc80e5e-eac5-4978-83f9-4a9e00b6c2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.577008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 899/1782] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:26.578769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1bc80e5e-eac5-4978-83f9-4a9e00b6c2cb None None] MFA Rules not processed for user `f70cacc673594047afc2de30ae208617`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:26.582075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1bc80e5e-eac5-4978-83f9-4a9e00b6c2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:26.764140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 884/1783] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:26.772401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260d74a-622c-41ce-938a-213be96a0355 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:26.794663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260d74a-622c-41ce-938a-213be96a0355 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:26.803239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:26.956622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a0cb-1808-43b7-9724-18f1d4b6f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:26.958586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a0cb-1808-43b7-9724-18f1d4b6f8ec admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:26.958725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a0cb-1808-43b7-9724-18f1d4b6f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:26.958954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099a0cb-1808-43b7-9724-18f1d4b6f8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:26.959728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099a0cb-1808-43b7-9724-18f1d4b6f8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:26.962978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099a0cb-1808-43b7-9724-18f1d4b6f8ec admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:27.066374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 900/1784] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:26 2022] POST /identity/v3/projects => generated 405 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:27.067915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc80e5e-eac5-4978-83f9-4a9e00b6c2cb None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:27.096174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc80e5e-eac5-4978-83f9-4a9e00b6c2cb None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:27.266574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b369ae-b2bb-4fe2-803b-175d417170d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:27.267336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b369ae-b2bb-4fe2-803b-175d417170d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:27.267613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b369ae-b2bb-4fe2-803b-175d417170d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:27.267882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b369ae-b2bb-4fe2-803b-175d417170d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:27.270251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b369ae-b2bb-4fe2-803b-175d417170d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:27.281068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b369ae-b2bb-4fe2-803b-175d417170d8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:27.346259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 885/1785] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:27 2022] POST /identity/v3/users => generated 309 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:27.346473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a0cb-1808-43b7-9724-18f1d4b6f8ec admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:27.366398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099a0cb-1808-43b7-9724-18f1d4b6f8ec admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:27.398575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6416f0-ba19-45bb-bca0-3be36a58ba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:27.399290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6416f0-ba19-45bb-bca0-3be36a58ba29 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:27.399576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6416f0-ba19-45bb-bca0-3be36a58ba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:27.399890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6416f0-ba19-45bb-bca0-3be36a58ba29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:27.400794 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6416f0-ba19-45bb-bca0-3be36a58ba29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:27.402469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6416f0-ba19-45bb-bca0-3be36a58ba29 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:27.444331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 901/1786] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:27.449966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b369ae-b2bb-4fe2-803b-175d417170d8 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:27.476169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b369ae-b2bb-4fe2-803b-175d417170d8 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:27.499309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6416f0-ba19-45bb-bca0-3be36a58ba29 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:27.501358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa59723-a56b-4ac9-b408-7af9ccb2abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:27.502325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa59723-a56b-4ac9-b408-7af9ccb2abe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:27.502612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa59723-a56b-4ac9-b408-7af9ccb2abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:27.502893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa59723-a56b-4ac9-b408-7af9ccb2abe5 admin admin] PATH_INFO: `/v3/projects/401d68f5707f4cc986917683a17ca452/users/48a571bbcc104652a19ab44037e7e566/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:27.538850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa59723-a56b-4ac9-b408-7af9ccb2abe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401d68f5707f4cc986917683a17ca452, user_id=48a571bbcc104652a19ab44037e7e566, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:27.541972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa59723-a56b-4ac9-b408-7af9ccb2abe5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:27.578828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 886/1787] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:27 2022] PUT /identity/v3/projects/401d68f5707f4cc986917683a17ca452/users/48a571bbcc104652a19ab44037e7e566/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:27.593877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa59723-a56b-4ac9-b408-7af9ccb2abe5 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:27.639069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:27.763813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa59723-a56b-4ac9-b408-7af9ccb2abe5 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:27.771224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6416f0-ba19-45bb-bca0-3be36a58ba29 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:27.772261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:27.773659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:27.778249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:27.778249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:27.778249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:27.778249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:27.800608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 887/1788] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:27.802004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:27.804346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:27.845019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a723709-b723-480a-8379-0159188cb99c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:27.861344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:27.864793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:27.865121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:27.865401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] PATH_INFO: `/v3/users/919fb1993a9f4e8699ac2a6c9a73d3bf` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:27.869809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919fb1993a9f4e8699ac2a6c9a73d3bf)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:27.878089 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:27.984850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919fb1993a9f4e8699ac2a6c9a73d3bf'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:27.997917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919fb1993a9f4e8699ac2a6c9a73d3bf'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.015023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919fb1993a9f4e8699ac2a6c9a73d3bf'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.023154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919fb1993a9f4e8699ac2a6c9a73d3bf'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.024002 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919fb1993a9f4e8699ac2a6c9a73d3bf'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.031478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 888/1789] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:27 2022] DELETE /identity/v3/users/919fb1993a9f4e8699ac2a6c9a73d3bf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:28.032619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:28.034459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.036666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987640cc-9b9b-4d98-9e28-942e3a93e2f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:28.037600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987640cc-9b9b-4d98-9e28-942e3a93e2f6 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:28.038177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987640cc-9b9b-4d98-9e28-942e3a93e2f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:28.038685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987640cc-9b9b-4d98-9e28-942e3a93e2f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:28.042028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-987640cc-9b9b-4d98-9e28-942e3a93e2f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.083157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987640cc-9b9b-4d98-9e28-942e3a93e2f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:28.084812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987640cc-9b9b-4d98-9e28-942e3a93e2f6 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:28.117902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e51ce-a4df-4376-90fd-4f03ff4b1ac6 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:28.119648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 902/1790] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:12:28.121126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b5ac-472e-4f4b-9617-b7c979c1d91c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:28.121464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b5ac-472e-4f4b-9617-b7c979c1d91c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:28.121691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b5ac-472e-4f4b-9617-b7c979c1d91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:28.123658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e17ee6-d52a-495c-a843-866315bc1edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:28.124575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e17ee6-d52a-495c-a843-866315bc1edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:28.124854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e17ee6-d52a-495c-a843-866315bc1edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:28.125136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e17ee6-d52a-495c-a843-866315bc1edf admin admin] PATH_INFO: `/v3/projects/401d68f5707f4cc986917683a17ca452/users/48a571bbcc104652a19ab44037e7e566/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:28.129293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e17ee6-d52a-495c-a843-866315bc1edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=401d68f5707f4cc986917683a17ca452, user_id=48a571bbcc104652a19ab44037e7e566, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:28.130118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e17ee6-d52a-495c-a843-866315bc1edf admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:28.139041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:28.152813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9309b5ac-472e-4f4b-9617-b7c979c1d91c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:28.154002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9309b5ac-472e-4f4b-9617-b7c979c1d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.159109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 889/1791] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:28 2022] PUT /identity/v3/projects/401d68f5707f4cc986917683a17ca452/users/48a571bbcc104652a19ab44037e7e566/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:28.169369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91bae5-8993-40ac-9d6a-de6f951e81fe None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:28.172803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91bae5-8993-40ac-9d6a-de6f951e81fe None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:28.173845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91bae5-8993-40ac-9d6a-de6f951e81fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:28.256696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0b91bae5-8993-40ac-9d6a-de6f951e81fe None None] MFA Rules not processed for user `48a571bbcc104652a19ab44037e7e566`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:28.259196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0b91bae5-8993-40ac-9d6a-de6f951e81fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.271596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:28.368477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 903/1792] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:28.368477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b5ac-472e-4f4b-9617-b7c979c1d91c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:28.371983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9309b5ac-472e-4f4b-9617-b7c979c1d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.435805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b5ac-472e-4f4b-9617-b7c979c1d91c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:28.442379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:28.443303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:28.443604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:28.443913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] PATH_INFO: `/v3/projects/9bab30797572474dbe2bcf13d7e3d0c8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:28.445689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bab30797572474dbe2bcf13d7e3d0c8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:28.447773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:28.453682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 890/1793] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:28.454950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91bae5-8993-40ac-9d6a-de6f951e81fe None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:28.456591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0b91bae5-8993-40ac-9d6a-de6f951e81fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.545449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bab30797572474dbe2bcf13d7e3d0c8', 'request_id': 'req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.558235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bab30797572474dbe2bcf13d7e3d0c8', 'request_id': 'req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.566657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bab30797572474dbe2bcf13d7e3d0c8', 'request_id': 'req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.587450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] The token cache is being invalidate because project 9bab30797572474dbe2bcf13d7e3d0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:28.588199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.589103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:28.591398 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 904/1794] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:28 2022] DELETE /identity/v3/projects/9bab30797572474dbe2bcf13d7e3d0c8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:28.592181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:28.593542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.692196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91bae5-8993-40ac-9d6a-de6f951e81fe None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:28.721044 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9064e-4405-4fe1-87dd-27f2fa51f9e9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:28.740236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:28.740911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:28.741191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:28.741468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:28.749870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.789906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:28.792752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:28.792752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:28.792752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:28.797726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.823755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:28.890683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:28.893825 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:28.919849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 905/1795] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:28.920877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:28.928360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:28.982216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:28.983728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:28.995371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 891/1796] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:29.054528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6124-62bc-4a57-a90d-c78e871709a5 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:29.059479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:29.060408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:29.060694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:29.060972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] PATH_INFO: `/v3/users/e797291336194e219990756994a84787` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:29.062332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e797291336194e219990756994a84787)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:29.064976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:29.120764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e797291336194e219990756994a84787'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.121525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e797291336194e219990756994a84787'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.130284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e797291336194e219990756994a84787'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.138093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e797291336194e219990756994a84787'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.153341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e797291336194e219990756994a84787'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.160263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 906/1797] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:28 2022] DELETE /identity/v3/users/e797291336194e219990756994a84787 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:29.280999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:29.283153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:29.299757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4941f-558a-4bfa-bac8-134e30f3c2ff service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:29.307154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:29.367872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:29.368767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:29.369044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:29.369315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] PATH_INFO: `/v3/projects/705c41a0ba4d41179c23816cc5b82cd3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:29.370563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=705c41a0ba4d41179c23816cc5b82cd3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:29.372513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:29.422007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705c41a0ba4d41179c23816cc5b82cd3', 'request_id': 'req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.427774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705c41a0ba4d41179c23816cc5b82cd3', 'request_id': 'req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.436801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705c41a0ba4d41179c23816cc5b82cd3', 'request_id': 'req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.454314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:29.456496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:29.458039 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] The token cache is being invalidate because project 705c41a0ba4d41179c23816cc5b82cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:29.458358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.459091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.461371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 892/1798] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:29 2022] DELETE /identity/v3/projects/705c41a0ba4d41179c23816cc5b82cd3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:29.465114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:29.466726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:29.481934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e23c-e63a-4a96-b7bd-3bb63570750c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:29.557315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f6d5-00c4-42a5-9ebd-d897dcd99b0b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:29.559832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:29.560846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:29.561279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:29.561540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] PATH_INFO: `/v3/projects/57b2c9ed78d0410c9f5bf149e79edeed` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:29.562758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b2c9ed78d0410c9f5bf149e79edeed)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:29.562977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:29.564292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:29.564579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:29.564851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] PATH_INFO: `/v3/users/6eac5318240b441ab4be2d5574f32f40` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:29.565597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:29.566289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eac5318240b441ab4be2d5574f32f40)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:29.567445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:29.568236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:29.619118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:29.623967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b2c9ed78d0410c9f5bf149e79edeed', 'request_id': 'req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.627097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eac5318240b441ab4be2d5574f32f40'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.632672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b2c9ed78d0410c9f5bf149e79edeed', 'request_id': 'req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.636803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eac5318240b441ab4be2d5574f32f40'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.639916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b2c9ed78d0410c9f5bf149e79edeed', 'request_id': 'req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.650195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eac5318240b441ab4be2d5574f32f40'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.652633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] The token cache is being invalidate because project 57b2c9ed78d0410c9f5bf149e79edeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:29.652925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.653546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1747bca7-ddad-4ac3-ba0b-c6927c1e3a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.655153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 907/1799] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:29 2022] DELETE /identity/v3/projects/57b2c9ed78d0410c9f5bf149e79edeed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:29.657166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eac5318240b441ab4be2d5574f32f40'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.658112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9566297d-337b-41ac-aa3c-d7386260c226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eac5318240b441ab4be2d5574f32f40'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:29.661444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba41b01-97a0-4a85-8d8e-a01852b456c5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:29.661892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba41b01-97a0-4a85-8d8e-a01852b456c5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:29.662173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba41b01-97a0-4a85-8d8e-a01852b456c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:29.664935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 893/1800] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:29 2022] DELETE /identity/v3/users/6eac5318240b441ab4be2d5574f32f40 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:29.681275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cba41b01-97a0-4a85-8d8e-a01852b456c5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:29.685989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cba41b01-97a0-4a85-8d8e-a01852b456c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:29.762509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 908/1801] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:29.764970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d872c59-3e19-4a73-916f-5c903ca228b6 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:29.765427 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d872c59-3e19-4a73-916f-5c903ca228b6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:29.765537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d872c59-3e19-4a73-916f-5c903ca228b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:29.786004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2d872c59-3e19-4a73-916f-5c903ca228b6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:29.787226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2d872c59-3e19-4a73-916f-5c903ca228b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:29.795609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 894/1802] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:29.800199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba41b01-97a0-4a85-8d8e-a01852b456c5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:29.810828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba41b01-97a0-4a85-8d8e-a01852b456c5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:29.816287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:29.816997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:29.817278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:29.817552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:29.818361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:29.818669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:29.820280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:29.834528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 909/1803] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:12:29.838764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d872c59-3e19-4a73-916f-5c903ca228b6 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:29.859638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d872c59-3e19-4a73-916f-5c903ca228b6 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:29.864903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:29.865630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:29.865922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:29.866219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:29.866930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:29.868854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:29.897961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 895/1804] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:29 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:12:29.902074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:29.915303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec106-1368-43ed-98ed-fd2ed974d9ff admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.074430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.078155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:30.134023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337d18f-10f1-4fd7-bd1e-1dc70199f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.134792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337d18f-10f1-4fd7-bd1e-1dc70199f145 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.135139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337d18f-10f1-4fd7-bd1e-1dc70199f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.135874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337d18f-10f1-4fd7-bd1e-1dc70199f145 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.137009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337d18f-10f1-4fd7-bd1e-1dc70199f145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.139150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337d18f-10f1-4fd7-bd1e-1dc70199f145 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.166964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 910/1805] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:29 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:12:30.169980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337d18f-10f1-4fd7-bd1e-1dc70199f145 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.183111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337d18f-10f1-4fd7-bd1e-1dc70199f145 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.191394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03c25-649e-4aaa-8210-12ce68f0ee16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.193202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03c25-649e-4aaa-8210-12ce68f0ee16 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.193202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03c25-649e-4aaa-8210-12ce68f0ee16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.193400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03c25-649e-4aaa-8210-12ce68f0ee16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.194697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03c25-649e-4aaa-8210-12ce68f0ee16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.196316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03c25-649e-4aaa-8210-12ce68f0ee16 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.198893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:30.209483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24ddb9-9729-461d-a7bf-902a88795dbb admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.214480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 911/1806] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:30.217582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03c25-649e-4aaa-8210-12ce68f0ee16 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.217707 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.220163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.220600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.222309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] PATH_INFO: `/v3/projects/861ce962b8a746deaa12b693a76f5e26` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.223748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861ce962b8a746deaa12b693a76f5e26)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.226049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.231427 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03c25-649e-4aaa-8210-12ce68f0ee16 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.236734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3922-41f9-4c8b-bd11-bf0d00f1716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.237533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3922-41f9-4c8b-bd11-bf0d00f1716b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.238526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3922-41f9-4c8b-bd11-bf0d00f1716b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.238526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3922-41f9-4c8b-bd11-bf0d00f1716b admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.239003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3922-41f9-4c8b-bd11-bf0d00f1716b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.240592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3922-41f9-4c8b-bd11-bf0d00f1716b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.261955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 912/1807] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:30.264470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3922-41f9-4c8b-bd11-bf0d00f1716b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.276749 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3922-41f9-4c8b-bd11-bf0d00f1716b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.281822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdf665-d22f-499d-8a88-175688fc06e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.282816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf665-d22f-499d-8a88-175688fc06e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.283093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf665-d22f-499d-8a88-175688fc06e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.283360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf665-d22f-499d-8a88-175688fc06e2 admin admin] PATH_INFO: `/v3/projects/b4352740813a4351b981b119d6f9b5b7/users/6c8678e7145d4f47a6004c88f6854ccb/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.300044 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf665-d22f-499d-8a88-175688fc06e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4352740813a4351b981b119d6f9b5b7, user_id=6c8678e7145d4f47a6004c88f6854ccb, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.303006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf665-d22f-499d-8a88-175688fc06e2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.305111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861ce962b8a746deaa12b693a76f5e26', 'request_id': 'req-67838267-f77d-4c86-bbf8-e4e0c930f527'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:30.312093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861ce962b8a746deaa12b693a76f5e26', 'request_id': 'req-67838267-f77d-4c86-bbf8-e4e0c930f527'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:30.319038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 913/1808] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:30 2022] PUT /identity/v3/projects/b4352740813a4351b981b119d6f9b5b7/users/6c8678e7145d4f47a6004c88f6854ccb/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:30.322903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861ce962b8a746deaa12b693a76f5e26', 'request_id': 'req-67838267-f77d-4c86-bbf8-e4e0c930f527'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:30.330994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fa40-18a8-4174-a106-e949031ae661 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.331630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fa40-18a8-4174-a106-e949031ae661 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.331907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fa40-18a8-4174-a106-e949031ae661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.339283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] The token cache is being invalidate because project 861ce962b8a746deaa12b693a76f5e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:30.339671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:30.340380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-67838267-f77d-4c86-bbf8-e4e0c930f527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:30.342296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 896/1809] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:30 2022] DELETE /identity/v3/projects/861ce962b8a746deaa12b693a76f5e26 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:30.347147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2c05-47d4-4575-914e-efcb92c92134 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.347785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2c05-47d4-4575-914e-efcb92c92134 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.347928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2c05-47d4-4575-914e-efcb92c92134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.360986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4cb3fa40-18a8-4174-a106-e949031ae661 None None] MFA Rules not processed for user `6c8678e7145d4f47a6004c88f6854ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:30.362526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4cb3fa40-18a8-4174-a106-e949031ae661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:30.367660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-46cc2c05-47d4-4575-914e-efcb92c92134 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:30.368959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-46cc2c05-47d4-4575-914e-efcb92c92134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:30.383617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:30.441080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 897/1810] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:30.443745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 914/1811] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:30.449159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc2c05-47d4-4575-914e-efcb92c92134 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.449765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8398e-bd3d-4878-b3ce-30fbc7ded010 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.450000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8398e-bd3d-4878-b3ce-30fbc7ded010 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.450275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8398e-bd3d-4878-b3ce-30fbc7ded010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.451011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-46cc2c05-47d4-4575-914e-efcb92c92134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:30.463661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc2c05-47d4-4575-914e-efcb92c92134 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.468893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8f5c-7cee-4ddd-97a9-a7523430492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.469581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8f5c-7cee-4ddd-97a9-a7523430492a admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.470034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8f5c-7cee-4ddd-97a9-a7523430492a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.470232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8f5c-7cee-4ddd-97a9-a7523430492a admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.470620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c1c8398e-bd3d-4878-b3ce-30fbc7ded010 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:30.471119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da8f5c-7cee-4ddd-97a9-a7523430492a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.471847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c1c8398e-bd3d-4878-b3ce-30fbc7ded010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:30.473033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da8f5c-7cee-4ddd-97a9-a7523430492a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.480955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 915/1812] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:30.486034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8398e-bd3d-4878-b3ce-30fbc7ded010 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.495931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8398e-bd3d-4878-b3ce-30fbc7ded010 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.500936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.501831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.502348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.502551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.503312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:30.503621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.505271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 898/1813] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:30 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:12:30.505385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.509210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8f5c-7cee-4ddd-97a9-a7523430492a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.518485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 916/1814] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:30.522860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.534714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12fff1-d049-412e-b8d0-799b4b7ab0df admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.587369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8f5c-7cee-4ddd-97a9-a7523430492a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.592337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198de5d-5498-4370-9045-ca34397d4f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.593017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198de5d-5498-4370-9045-ca34397d4f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.593474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198de5d-5498-4370-9045-ca34397d4f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.593700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198de5d-5498-4370-9045-ca34397d4f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.594426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198de5d-5498-4370-9045-ca34397d4f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.598862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198de5d-5498-4370-9045-ca34397d4f5f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.605557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b2c59-10d3-4b86-8ebf-5c766c321b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.606523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b2c59-10d3-4b86-8ebf-5c766c321b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.606808 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b2c59-10d3-4b86-8ebf-5c766c321b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.607117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b2c59-10d3-4b86-8ebf-5c766c321b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.607901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b2c59-10d3-4b86-8ebf-5c766c321b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.609992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b2c59-10d3-4b86-8ebf-5c766c321b39 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.625000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 899/1815] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:30 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:12:30.626572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198de5d-5498-4370-9045-ca34397d4f5f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.640480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198de5d-5498-4370-9045-ca34397d4f5f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.652475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad98442-25fe-4d00-ac4c-c2a9e5ce95a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.654120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98442-25fe-4d00-ac4c-c2a9e5ce95a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.654783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98442-25fe-4d00-ac4c-c2a9e5ce95a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.655257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98442-25fe-4d00-ac4c-c2a9e5ce95a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.657275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad98442-25fe-4d00-ac4c-c2a9e5ce95a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.659917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad98442-25fe-4d00-ac4c-c2a9e5ce95a3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.670747 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 917/1816] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:30 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:12:30.672740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b2c59-10d3-4b86-8ebf-5c766c321b39 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.681763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 900/1817] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:30.685404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad98442-25fe-4d00-ac4c-c2a9e5ce95a3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.698764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad98442-25fe-4d00-ac4c-c2a9e5ce95a3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.710566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:30.762536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa695b1d-098d-42c0-bb20-ed3aeef3e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.764333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa695b1d-098d-42c0-bb20-ed3aeef3e5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.764697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa695b1d-098d-42c0-bb20-ed3aeef3e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.765151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa695b1d-098d-42c0-bb20-ed3aeef3e5cd admin admin] PATH_INFO: `/v3/projects/db3330dd93e84bb5ba997d82b4b3c29f/users/e3a91295b5b54dc391771b6bd3dcb2cc/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.785289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa695b1d-098d-42c0-bb20-ed3aeef3e5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3330dd93e84bb5ba997d82b4b3c29f, user_id=e3a91295b5b54dc391771b6bd3dcb2cc, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.787344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b2c59-10d3-4b86-8ebf-5c766c321b39 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.788056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa695b1d-098d-42c0-bb20-ed3aeef3e5cd admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.796475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7863f6-58e8-434d-848e-368548ce36d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.797784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7863f6-58e8-434d-848e-368548ce36d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.798327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7863f6-58e8-434d-848e-368548ce36d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.798783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7863f6-58e8-434d-848e-368548ce36d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.800191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7863f6-58e8-434d-848e-368548ce36d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.802740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:30.804934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7863f6-58e8-434d-848e-368548ce36d8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.809898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 901/1818] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:30 2022] PUT /identity/v3/projects/db3330dd93e84bb5ba997d82b4b3c29f/users/e3a91295b5b54dc391771b6bd3dcb2cc/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:30.814817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa695b1d-098d-42c0-bb20-ed3aeef3e5cd admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.850957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 918/1819] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:30 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:30.860533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7863f6-58e8-434d-848e-368548ce36d8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.886045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7863f6-58e8-434d-848e-368548ce36d8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.913003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa695b1d-098d-42c0-bb20-ed3aeef3e5cd admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.919968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80cd42-dac2-4b87-b74a-bf6c59cdb28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.922011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80cd42-dac2-4b87-b74a-bf6c59cdb28e admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.922502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80cd42-dac2-4b87-b74a-bf6c59cdb28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.922917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80cd42-dac2-4b87-b74a-bf6c59cdb28e admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.924975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80cd42-dac2-4b87-b74a-bf6c59cdb28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.927061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80cd42-dac2-4b87-b74a-bf6c59cdb28e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.942181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 902/1820] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:12:30.946571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80cd42-dac2-4b87-b74a-bf6c59cdb28e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.959578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80cd42-dac2-4b87-b74a-bf6c59cdb28e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:30.964498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919271-bedf-4871-9b21-48fd3beb6e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.965395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919271-bedf-4871-9b21-48fd3beb6e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.965781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919271-bedf-4871-9b21-48fd3beb6e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.966088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919271-bedf-4871-9b21-48fd3beb6e36 admin admin] PATH_INFO: `/v3/projects/db3330dd93e84bb5ba997d82b4b3c29f/users/e3a91295b5b54dc391771b6bd3dcb2cc/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.967660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a034e-ad60-4c89-a499-3083cb81c10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:30.968383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a034e-ad60-4c89-a499-3083cb81c10e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:30.968654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3919271-bedf-4871-9b21-48fd3beb6e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3330dd93e84bb5ba997d82b4b3c29f, user_id=e3a91295b5b54dc391771b6bd3dcb2cc, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.968748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a034e-ad60-4c89-a499-3083cb81c10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:30.969020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a034e-ad60-4c89-a499-3083cb81c10e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:30.969773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a034e-ad60-4c89-a499-3083cb81c10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:30.971528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a034e-ad60-4c89-a499-3083cb81c10e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.972032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3919271-bedf-4871-9b21-48fd3beb6e36 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:30.982615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 919/1821] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:12:30.986805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a034e-ad60-4c89-a499-3083cb81c10e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:30.991420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 903/1822] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:30 2022] PUT /identity/v3/projects/db3330dd93e84bb5ba997d82b4b3c29f/users/e3a91295b5b54dc391771b6bd3dcb2cc/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:31.003301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a34bd-c609-4938-b451-14ea6d9ff080 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.003913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a34bd-c609-4938-b451-14ea6d9ff080 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.004366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a34bd-c609-4938-b451-14ea6d9ff080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.008511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a034e-ad60-4c89-a499-3083cb81c10e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.035689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4c6a34bd-c609-4938-b451-14ea6d9ff080 None None] MFA Rules not processed for user `e3a91295b5b54dc391771b6bd3dcb2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:31.037012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4c6a34bd-c609-4938-b451-14ea6d9ff080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:31.098817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e45c-a474-4cbb-8f30-cceed6236d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.099838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e45c-a474-4cbb-8f30-cceed6236d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.100183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e45c-a474-4cbb-8f30-cceed6236d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.100477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e45c-a474-4cbb-8f30-cceed6236d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.101228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e45c-a474-4cbb-8f30-cceed6236d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.103136 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e45c-a474-4cbb-8f30-cceed6236d95 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.117331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 920/1823] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:12:31.121971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e45c-a474-4cbb-8f30-cceed6236d95 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.137670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e45c-a474-4cbb-8f30-cceed6236d95 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.139214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 904/1824] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:31.142935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.144042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.145887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.146182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] PATH_INFO: `/v3/projects/70ada299fb7e43b1b2b4ab1f8dc890d4/users/c2de038823834f0ab99233076b847763/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.163966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ada299fb7e43b1b2b4ab1f8dc890d4, user_id=c2de038823834f0ab99233076b847763, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.167190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.193476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 921/1825] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:31 2022] PUT /identity/v3/projects/70ada299fb7e43b1b2b4ab1f8dc890d4/users/c2de038823834f0ab99233076b847763/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:31.204620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec65e0-224a-4b53-80bc-59e794f3b691 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.205018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec65e0-224a-4b53-80bc-59e794f3b691 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.205357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec65e0-224a-4b53-80bc-59e794f3b691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.212410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.214131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:31.228609 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:31.233582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c9ec65e0-224a-4b53-80bc-59e794f3b691 None None] MFA Rules not processed for user `c2de038823834f0ab99233076b847763`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:31.235234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c9ec65e0-224a-4b53-80bc-59e794f3b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:31.279043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fe445-abd1-4ef1-8b11-ec7f0153f905 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.284466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1480-b2a6-40c3-840e-c22888bc6ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.285234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1480-b2a6-40c3-840e-c22888bc6ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.288080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1480-b2a6-40c3-840e-c22888bc6ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.288080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1480-b2a6-40c3-840e-c22888bc6ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.298426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:31.308699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 905/1826] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:31.309599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec65e0-224a-4b53-80bc-59e794f3b691 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.367691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1480-b2a6-40c3-840e-c22888bc6ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.369148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1480-b2a6-40c3-840e-c22888bc6ec8 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.378720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec65e0-224a-4b53-80bc-59e794f3b691 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.383873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc615-ccb7-4b03-9c81-fa73e53d1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.384651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc615-ccb7-4b03-9c81-fa73e53d1db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.385122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc615-ccb7-4b03-9c81-fa73e53d1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.385520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc615-ccb7-4b03-9c81-fa73e53d1db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.386101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 922/1827] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:12:31.386526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbc615-ccb7-4b03-9c81-fa73e53d1db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.395999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbc615-ccb7-4b03-9c81-fa73e53d1db4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.417732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 906/1828] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:31 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:31.421438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1480-b2a6-40c3-840e-c22888bc6ec8 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.431873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1480-b2a6-40c3-840e-c22888bc6ec8 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.491094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9734cef-b30a-497f-b76d-8de5d62e52ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.491806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9734cef-b30a-497f-b76d-8de5d62e52ba admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.492108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9734cef-b30a-497f-b76d-8de5d62e52ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.492396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9734cef-b30a-497f-b76d-8de5d62e52ba admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.493106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9734cef-b30a-497f-b76d-8de5d62e52ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.495160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9734cef-b30a-497f-b76d-8de5d62e52ba admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.517073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 923/1829] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:31 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:31.521167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc615-ccb7-4b03-9c81-fa73e53d1db4 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.531918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc615-ccb7-4b03-9c81-fa73e53d1db4 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.537181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd1520-3f32-4df8-b023-8a6579e8bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.537982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1520-3f32-4df8-b023-8a6579e8bc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.538352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1520-3f32-4df8-b023-8a6579e8bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.538697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1520-3f32-4df8-b023-8a6579e8bc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.539504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd1520-3f32-4df8-b023-8a6579e8bc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.541180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd1520-3f32-4df8-b023-8a6579e8bc84 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.552540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 907/1830] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:31.556788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9734cef-b30a-497f-b76d-8de5d62e52ba admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.567341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9734cef-b30a-497f-b76d-8de5d62e52ba admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.572059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08327a5c-af9f-47c7-9f65-922e6c5df89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.572988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08327a5c-af9f-47c7-9f65-922e6c5df89f admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.573271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08327a5c-af9f-47c7-9f65-922e6c5df89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.573548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08327a5c-af9f-47c7-9f65-922e6c5df89f admin admin] PATH_INFO: `/v3/projects/4a4a846e1f11414e8b841ee6dd1cfbc7/users/c5b331b494884752beb2c8eefffe857a/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.588907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08327a5c-af9f-47c7-9f65-922e6c5df89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4a846e1f11414e8b841ee6dd1cfbc7, user_id=c5b331b494884752beb2c8eefffe857a, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.591626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08327a5c-af9f-47c7-9f65-922e6c5df89f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.607233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 924/1831] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:31 2022] PUT /identity/v3/projects/4a4a846e1f11414e8b841ee6dd1cfbc7/users/c5b331b494884752beb2c8eefffe857a/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:31.611353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd1520-3f32-4df8-b023-8a6579e8bc84 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.622743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd1520-3f32-4df8-b023-8a6579e8bc84 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.689368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd4e09-b844-45c1-8ccf-759cd527a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.690036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd4e09-b844-45c1-8ccf-759cd527a21d admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.690285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd4e09-b844-45c1-8ccf-759cd527a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.690559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd4e09-b844-45c1-8ccf-759cd527a21d admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.691301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd4e09-b844-45c1-8ccf-759cd527a21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.692920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd4e09-b844-45c1-8ccf-759cd527a21d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.703745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 908/1832] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:31.707887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08327a5c-af9f-47c7-9f65-922e6c5df89f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.718809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08327a5c-af9f-47c7-9f65-922e6c5df89f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.723964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b2df-2168-426b-b394-753958aa13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.724936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b2df-2168-426b-b394-753958aa13a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.725286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b2df-2168-426b-b394-753958aa13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.725647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b2df-2168-426b-b394-753958aa13a1 admin admin] PATH_INFO: `/v3/projects/4a4a846e1f11414e8b841ee6dd1cfbc7/users/c5b331b494884752beb2c8eefffe857a/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.727774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b2df-2168-426b-b394-753958aa13a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4a846e1f11414e8b841ee6dd1cfbc7, user_id=c5b331b494884752beb2c8eefffe857a, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.730645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b2df-2168-426b-b394-753958aa13a1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.742162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 925/1833] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:31 2022] PUT /identity/v3/projects/4a4a846e1f11414e8b841ee6dd1cfbc7/users/c5b331b494884752beb2c8eefffe857a/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:31.753746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff6553-3cb6-44d8-81ba-cdf5a4dc4f0c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.754097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff6553-3cb6-44d8-81ba-cdf5a4dc4f0c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.754359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b2df-2168-426b-b394-753958aa13a1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.754460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff6553-3cb6-44d8-81ba-cdf5a4dc4f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.773757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:31.781839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-bfff6553-3cb6-44d8-81ba-cdf5a4dc4f0c None None] MFA Rules not processed for user `c5b331b494884752beb2c8eefffe857a`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:31.783260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bfff6553-3cb6-44d8-81ba-cdf5a4dc4f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:31.822324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b2df-2168-426b-b394-753958aa13a1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.827716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a91295b5b54dc391771b6bd3dcb2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3330dd93e84bb5ba997d82b4b3c29f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.828524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.828812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.829126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.829982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:31.830288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.831900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.842134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:31.843745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 926/1834] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:12:31.849084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.858915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad012c-afdc-447d-9608-fea3bc6f1905 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.861178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 909/1835] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:31.864505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f08e30-15e7-4f62-adb9-ae17e8011fff tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a91295b5b54dc391771b6bd3dcb2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3330dd93e84bb5ba997d82b4b3c29f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.865184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08e30-15e7-4f62-adb9-ae17e8011fff tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.865470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08e30-15e7-4f62-adb9-ae17e8011fff tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.865746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08e30-15e7-4f62-adb9-ae17e8011fff tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.866492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f08e30-15e7-4f62-adb9-ae17e8011fff tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.868431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f08e30-15e7-4f62-adb9-ae17e8011fff tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:31.868922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff6553-3cb6-44d8-81ba-cdf5a4dc4f0c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.904265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 927/1836] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:31 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:12:31.908511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f08e30-15e7-4f62-adb9-ae17e8011fff tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:31.931209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff6553-3cb6-44d8-81ba-cdf5a4dc4f0c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.982461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f08e30-15e7-4f62-adb9-ae17e8011fff tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:31.984140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79175b-0a2e-49b0-8f50-f84c4567170f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.984895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79175b-0a2e-49b0-8f50-f84c4567170f service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.985256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79175b-0a2e-49b0-8f50-f84c4567170f service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.986228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79175b-0a2e-49b0-8f50-f84c4567170f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.988369 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a91295b5b54dc391771b6bd3dcb2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3330dd93e84bb5ba997d82b4b3c29f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:31.989051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:31.989335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:31.989613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:31.990390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:31.990704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:31.992329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:32.004957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 928/1837] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:32.054693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79175b-0a2e-49b0-8f50-f84c4567170f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:32.056065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79175b-0a2e-49b0-8f50-f84c4567170f service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:32.066966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 910/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:12:32.094938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:32.143833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79175b-0a2e-49b0-8f50-f84c4567170f service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:32.154440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79175b-0a2e-49b0-8f50-f84c4567170f service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:32.159489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a91295b5b54dc391771b6bd3dcb2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3330dd93e84bb5ba997d82b4b3c29f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:32.160396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:32.160680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:32.160952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] PATH_INFO: `/v3/projects/d1733db828c248d09b71bb34ff48483e` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:32.161329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee780d7e-ad7f-4e71-bf69-82e4aef4f8cd tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:32.162159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d1733db828c248d09b71bb34ff48483e)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:32.164077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:32.166574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:32.167491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:32.167775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:32.168061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] PATH_INFO: `/v3/users/c2de038823834f0ab99233076b847763` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:32.169297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2de038823834f0ab99233076b847763)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:32.171284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:32.196057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:32.223810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1733db828c248d09b71bb34ff48483e', 'request_id': 'req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.227080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2de038823834f0ab99233076b847763'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.227845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2de038823834f0ab99233076b847763'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.228418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:32.231528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1733db828c248d09b71bb34ff48483e', 'request_id': 'req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.238677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2de038823834f0ab99233076b847763'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.241154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1733db828c248d09b71bb34ff48483e', 'request_id': 'req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.248497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2de038823834f0ab99233076b847763'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.260171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] The token cache is being invalidate because project d1733db828c248d09b71bb34ff48483e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:32.260599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.261414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1e6d08fd-86fe-4ae8-8d42-3dc980d4c5e1 tempest-VolumeQuotaClassesTest-1675697744 tempest-VolumeQuotaClassesTest-1675697744-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.263741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 911/1839] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:32 2022] DELETE /identity/v3/projects/d1733db828c248d09b71bb34ff48483e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:32.268152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2de038823834f0ab99233076b847763'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.274709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 929/1840] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:32 2022] DELETE /identity/v3/users/c2de038823834f0ab99233076b847763 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:32.278947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2b68-6588-419a-88cd-56766fdf3415 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:32.279237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2b68-6588-419a-88cd-56766fdf3415 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:32.279512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2b68-6588-419a-88cd-56766fdf3415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:32.303421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b5ea2b68-6588-419a-88cd-56766fdf3415 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:32.305309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b5ea2b68-6588-419a-88cd-56766fdf3415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:32.379263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 912/1841] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:32.389131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:32.390558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:32.460295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141737-dff0-4939-af0c-4ec42bad5cc7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:32.465315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aa32b-aac8-4d70-85b2-1432b0d114fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:32.466014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa32b-aac8-4d70-85b2-1432b0d114fe service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:32.466294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa32b-aac8-4d70-85b2-1432b0d114fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:32.466683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aa32b-aac8-4d70-85b2-1432b0d114fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:32.480901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aa32b-aac8-4d70-85b2-1432b0d114fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:32.482672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aa32b-aac8-4d70-85b2-1432b0d114fe service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:32.493235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 930/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:32.533614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2b68-6588-419a-88cd-56766fdf3415 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:32.535153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b5ea2b68-6588-419a-88cd-56766fdf3415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:32.546908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2b68-6588-419a-88cd-56766fdf3415 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:32.551800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:32.552694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:32.552973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:32.553246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] PATH_INFO: `/v3/users/6c8678e7145d4f47a6004c88f6854ccb` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:32.554499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8678e7145d4f47a6004c88f6854ccb)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:32.556490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:32.616810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8678e7145d4f47a6004c88f6854ccb'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.625301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8678e7145d4f47a6004c88f6854ccb'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.639836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8678e7145d4f47a6004c88f6854ccb'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.647843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8678e7145d4f47a6004c88f6854ccb'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.648619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8678e7145d4f47a6004c88f6854ccb'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.654578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 913/1843] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:32 2022] DELETE /identity/v3/users/6c8678e7145d4f47a6004c88f6854ccb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:32.659396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12639ef-20a7-497d-a363-611fdb94e37a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:32.659689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12639ef-20a7-497d-a363-611fdb94e37a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:32.659965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12639ef-20a7-497d-a363-611fdb94e37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:32.678551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e12639ef-20a7-497d-a363-611fdb94e37a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:32.679777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e12639ef-20a7-497d-a363-611fdb94e37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:32.743114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 931/1844] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:32.753192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:32.754674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:32.822600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12639ef-20a7-497d-a363-611fdb94e37a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:32.824353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e12639ef-20a7-497d-a363-611fdb94e37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:32.836710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12639ef-20a7-497d-a363-611fdb94e37a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:32.838172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6e037-d82f-4003-99f6-31a2f3aad897 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:32.842291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:32.842421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:32.843072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:32.843418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:32.843702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:32.843792 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:32.843987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:32.844323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] PATH_INFO: `/v3/projects/70ada299fb7e43b1b2b4ab1f8dc890d4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:32.853734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ada299fb7e43b1b2b4ab1f8dc890d4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:32.854638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:32.855981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:32.856151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:32.860719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:32.869679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 914/1845] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:12:32.889120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:32.891849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:32.916512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad9a7e-a54b-4b94-bc9a-3575e451375c service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:32.927976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:32.948415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ada299fb7e43b1b2b4ab1f8dc890d4', 'request_id': 'req-59456af2-a30f-4115-bbdf-795b49f0603f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.961630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ada299fb7e43b1b2b4ab1f8dc890d4', 'request_id': 'req-59456af2-a30f-4115-bbdf-795b49f0603f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.970532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ada299fb7e43b1b2b4ab1f8dc890d4', 'request_id': 'req-59456af2-a30f-4115-bbdf-795b49f0603f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.987731 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] The token cache is being invalidate because project 70ada299fb7e43b1b2b4ab1f8dc890d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:32.988064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.990253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:32.991880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 932/1846] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:32 2022] DELETE /identity/v3/projects/70ada299fb7e43b1b2b4ab1f8dc890d4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:32.996649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:32.998226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:33.016112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:33.017125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:33.017394 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:33.017731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] PATH_INFO: `/v3/users/f70cacc673594047afc2de30ae208617` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:33.018917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70cacc673594047afc2de30ae208617)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:33.021719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:33.084318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456af2-a30f-4115-bbdf-795b49f0603f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:33.089116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:33.090106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:33.090387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:33.090662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] PATH_INFO: `/v3/users/c5b331b494884752beb2c8eefffe857a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:33.091863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b331b494884752beb2c8eefffe857a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:33.093821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:33.098263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70cacc673594047afc2de30ae208617'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.116317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70cacc673594047afc2de30ae208617'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.144532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70cacc673594047afc2de30ae208617'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.167583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70cacc673594047afc2de30ae208617'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.168328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6655a220-4a3a-407b-add0-1a90cb93c231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70cacc673594047afc2de30ae208617'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.178315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 915/1847] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:32 2022] DELETE /identity/v3/users/f70cacc673594047afc2de30ae208617 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:33.183388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22620e5-d9e2-4791-80f7-ecc58b2b3c4c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:33.183677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22620e5-d9e2-4791-80f7-ecc58b2b3c4c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:33.183962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22620e5-d9e2-4791-80f7-ecc58b2b3c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:33.186851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b331b494884752beb2c8eefffe857a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.187556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b331b494884752beb2c8eefffe857a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.200575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b331b494884752beb2c8eefffe857a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.207895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c22620e5-d9e2-4791-80f7-ecc58b2b3c4c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:33.209374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c22620e5-d9e2-4791-80f7-ecc58b2b3c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:33.210308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b331b494884752beb2c8eefffe857a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.225422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b331b494884752beb2c8eefffe857a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.241892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 933/1848] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:32 2022] DELETE /identity/v3/users/c5b331b494884752beb2c8eefffe857a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:33.287103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:33.290203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:33.301182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 916/1849] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:33.357099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22620e5-d9e2-4791-80f7-ecc58b2b3c4c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:33.360959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:33.363285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c22620e5-d9e2-4791-80f7-ecc58b2b3c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:33.401001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79ec8c-44e0-4888-b95e-ed654f70c6e2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:33.411936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:33.413304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:33.413585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:33.413913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] PATH_INFO: `/v3/projects/b4352740813a4351b981b119d6f9b5b7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:33.416068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4352740813a4351b981b119d6f9b5b7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:33.433032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:33.444942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:33.516966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22620e5-d9e2-4791-80f7-ecc58b2b3c4c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:33.571215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4352740813a4351b981b119d6f9b5b7', 'request_id': 'req-05d16c9f-b34f-45ac-80bc-fde2362b6952'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.581117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4352740813a4351b981b119d6f9b5b7', 'request_id': 'req-05d16c9f-b34f-45ac-80bc-fde2362b6952'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.591441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4352740813a4351b981b119d6f9b5b7', 'request_id': 'req-05d16c9f-b34f-45ac-80bc-fde2362b6952'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.607580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dad17b-76d7-4a9d-a8da-09ebbc3a7a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:33.608302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dad17b-76d7-4a9d-a8da-09ebbc3a7a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:33.608512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dad17b-76d7-4a9d-a8da-09ebbc3a7a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:33.608783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dad17b-76d7-4a9d-a8da-09ebbc3a7a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:33.631214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dad17b-76d7-4a9d-a8da-09ebbc3a7a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:33.632826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dad17b-76d7-4a9d-a8da-09ebbc3a7a54 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:33.649022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] The token cache is being invalidate because project b4352740813a4351b981b119d6f9b5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:33.651550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.653863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.657276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 934/1850] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:33 2022] DELETE /identity/v3/projects/b4352740813a4351b981b119d6f9b5b7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:33.658799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 917/1851] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:33.661552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dad17b-76d7-4a9d-a8da-09ebbc3a7a54 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:33.687546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dad17b-76d7-4a9d-a8da-09ebbc3a7a54 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:33.799100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:33.800526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:33.807611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:33.809449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:33.810967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:33.811423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] PATH_INFO: `/v3/users/e3a91295b5b54dc391771b6bd3dcb2cc` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:33.813112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a91295b5b54dc391771b6bd3dcb2cc)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:33.818626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d16c9f-b34f-45ac-80bc-fde2362b6952 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:33.819357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:33.826709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:33.828530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:33.828857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:33.829164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] PATH_INFO: `/v3/users/c22a03f0719d4ddcbb95661878f184f2` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:33.830477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22a03f0719d4ddcbb95661878f184f2)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:33.833518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:33.889763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a91295b5b54dc391771b6bd3dcb2cc'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.919529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a91295b5b54dc391771b6bd3dcb2cc'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.949454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a91295b5b54dc391771b6bd3dcb2cc'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.955742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:33.965603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a91295b5b54dc391771b6bd3dcb2cc'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.965603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-beeb3929-0719-4f50-a9bc-57532b98ab63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a91295b5b54dc391771b6bd3dcb2cc'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.970765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 918/1852] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:33 2022] DELETE /identity/v3/users/e3a91295b5b54dc391771b6bd3dcb2cc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:33.972464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22a03f0719d4ddcbb95661878f184f2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.973218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22a03f0719d4ddcbb95661878f184f2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:33.984508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22a03f0719d4ddcbb95661878f184f2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.021299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22a03f0719d4ddcbb95661878f184f2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.076056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22a03f0719d4ddcbb95661878f184f2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.089929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 935/1853] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:33 2022] DELETE /identity/v3/users/c22a03f0719d4ddcbb95661878f184f2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:34.097193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4adef5-fc37-4f52-b0c4-5127dc00dc65 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.097464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4adef5-fc37-4f52-b0c4-5127dc00dc65 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.098569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4adef5-fc37-4f52-b0c4-5127dc00dc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.105513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.107288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.144894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4c4adef5-fc37-4f52-b0c4-5127dc00dc65 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:34.146813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4c4adef5-fc37-4f52-b0c4-5127dc00dc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.241949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:34.267938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99c56-f9ee-45dd-94bc-dc0a985c812b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.269127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 919/1854] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:34.276007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4adef5-fc37-4f52-b0c4-5127dc00dc65 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.277551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4c4adef5-fc37-4f52-b0c4-5127dc00dc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.282672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.284077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.286562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.286876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] PATH_INFO: `/v3/projects/4a4a846e1f11414e8b841ee6dd1cfbc7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.290469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4a846e1f11414e8b841ee6dd1cfbc7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.290745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4adef5-fc37-4f52-b0c4-5127dc00dc65 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.293346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.296156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.297051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.297329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.297630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] PATH_INFO: `/v3/projects/4b5dd4c269074b7b8a0cee4e00350f38` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.299146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5dd4c269074b7b8a0cee4e00350f38)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.301785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.348008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4a846e1f11414e8b841ee6dd1cfbc7', 'request_id': 'req-68b39ad7-692f-4b99-9129-3968ca2204c2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.353984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4a846e1f11414e8b841ee6dd1cfbc7', 'request_id': 'req-68b39ad7-692f-4b99-9129-3968ca2204c2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.358889 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5dd4c269074b7b8a0cee4e00350f38', 'request_id': 'req-81ac499f-9da2-4c3d-a6c1-76913395406e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.361289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4a846e1f11414e8b841ee6dd1cfbc7', 'request_id': 'req-68b39ad7-692f-4b99-9129-3968ca2204c2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.365142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5dd4c269074b7b8a0cee4e00350f38', 'request_id': 'req-81ac499f-9da2-4c3d-a6c1-76913395406e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.372941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5dd4c269074b7b8a0cee4e00350f38', 'request_id': 'req-81ac499f-9da2-4c3d-a6c1-76913395406e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.379029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] The token cache is being invalidate because project 4a4a846e1f11414e8b841ee6dd1cfbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:34.379427 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.380201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.385463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 936/1855] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:34 2022] DELETE /identity/v3/projects/4a4a846e1f11414e8b841ee6dd1cfbc7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:34.386776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.388168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.388946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] The token cache is being invalidate because project 4b5dd4c269074b7b8a0cee4e00350f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:34.389745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.390579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-81ac499f-9da2-4c3d-a6c1-76913395406e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.395289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 920/1856] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:34 2022] DELETE /identity/v3/projects/4b5dd4c269074b7b8a0cee4e00350f38 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:34.395289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0af41-3e26-46eb-9c69-80a2701c6e89 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.395289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0af41-3e26-46eb-9c69-80a2701c6e89 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.395289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0af41-3e26-46eb-9c69-80a2701c6e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.415705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d8b0af41-3e26-46eb-9c69-80a2701c6e89 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:34.416952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d8b0af41-3e26-46eb-9c69-80a2701c6e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.466250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b39ad7-692f-4b99-9129-3968ca2204c2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.499338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 921/1857] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:34.500374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0af41-3e26-46eb-9c69-80a2701c6e89 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.501746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d8b0af41-3e26-46eb-9c69-80a2701c6e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.514350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0af41-3e26-46eb-9c69-80a2701c6e89 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.519413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.520299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.520576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.520845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] PATH_INFO: `/v3/users/48a571bbcc104652a19ab44037e7e566` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.522056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a571bbcc104652a19ab44037e7e566)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.524191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.528486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.529224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.529572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.532591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.534156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.541317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:34.547468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.548984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.560187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 937/1858] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:34.561693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.563249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.576902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38508cee-2db9-477c-b9db-064604cf006e service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.582407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.583285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.583969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.583969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] PATH_INFO: `/v3/projects/db3330dd93e84bb5ba997d82b4b3c29f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.584985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3330dd93e84bb5ba997d82b4b3c29f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.586930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.592970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a571bbcc104652a19ab44037e7e566'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.606974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a571bbcc104652a19ab44037e7e566'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.622112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a571bbcc104652a19ab44037e7e566'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.629515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:34.632596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a571bbcc104652a19ab44037e7e566'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.634807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f6b89a63-3ba7-4abe-94d5-bb566d56c5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a571bbcc104652a19ab44037e7e566'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.643884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 922/1859] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:34 2022] DELETE /identity/v3/users/48a571bbcc104652a19ab44037e7e566 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:34.646177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c107f4-9afa-49b3-befc-93b5de929f23 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.646449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3330dd93e84bb5ba997d82b4b3c29f', 'request_id': 'req-1b2501d4-3a38-4b66-949b-0abee2f6f65f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.646967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c107f4-9afa-49b3-befc-93b5de929f23 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.647450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c107f4-9afa-49b3-befc-93b5de929f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.653613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3330dd93e84bb5ba997d82b4b3c29f', 'request_id': 'req-1b2501d4-3a38-4b66-949b-0abee2f6f65f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.662426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3330dd93e84bb5ba997d82b4b3c29f', 'request_id': 'req-1b2501d4-3a38-4b66-949b-0abee2f6f65f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.676153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-32c107f4-9afa-49b3-befc-93b5de929f23 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:34.677514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-32c107f4-9afa-49b3-befc-93b5de929f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.688206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] The token cache is being invalidate because project db3330dd93e84bb5ba997d82b4b3c29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:34.688206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.688206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1b2501d4-3a38-4b66-949b-0abee2f6f65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:34.695393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 938/1860] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:34 2022] DELETE /identity/v3/projects/db3330dd93e84bb5ba997d82b4b3c29f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:34.702632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee84ec-e39a-450d-99a4-8ca38389bd76 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.703745 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee84ec-e39a-450d-99a4-8ca38389bd76 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.705095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee84ec-e39a-450d-99a4-8ca38389bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.728911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-21ee84ec-e39a-450d-99a4-8ca38389bd76 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:34.730204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-21ee84ec-e39a-450d-99a4-8ca38389bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.786903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 923/1861] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:34.791202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c107f4-9afa-49b3-befc-93b5de929f23 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.801527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c107f4-9afa-49b3-befc-93b5de929f23 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.807046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.807744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.808107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.808482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.809286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:34.809616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.811445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.816486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 939/1862] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:34.825446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15a183-6552-4346-a600-ed7e39d58415 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.826657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15a183-6552-4346-a600-ed7e39d58415 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.827145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15a183-6552-4346-a600-ed7e39d58415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.848918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7b15a183-6552-4346-a600-ed7e39d58415 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:34.850327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7b15a183-6552-4346-a600-ed7e39d58415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:34.855173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 924/1863] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:12:34.863639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 940/1864] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:34.864683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.866182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15a183-6552-4346-a600-ed7e39d58415 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.879532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15a183-6552-4346-a600-ed7e39d58415 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.883946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01cbd1-8303-4a93-95fb-911038f48bec admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.884362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.885117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.885321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.885749 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.886636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:34.886822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.888431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.889584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b6b23-f108-4873-8ca5-7c6fa79c27a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.890352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6b23-f108-4873-8ca5-7c6fa79c27a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.890890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6b23-f108-4873-8ca5-7c6fa79c27a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.891514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6b23-f108-4873-8ca5-7c6fa79c27a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.892170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b6b23-f108-4873-8ca5-7c6fa79c27a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.894765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b6b23-f108-4873-8ca5-7c6fa79c27a1 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.907410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 941/1865] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:34.908843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:34.926092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9b51-6806-450c-a32b-54cb814718fd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:34.938084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5346872-3629-487f-96e4-1a7e6a1f7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:34.940485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346872-3629-487f-96e4-1a7e6a1f7ace admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:34.941285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346872-3629-487f-96e4-1a7e6a1f7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:34.941285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5346872-3629-487f-96e4-1a7e6a1f7ace admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:34.941750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5346872-3629-487f-96e4-1a7e6a1f7ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:34.943757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5346872-3629-487f-96e4-1a7e6a1f7ace admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:34.951840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 925/1866] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:34 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:34.953411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b6b23-f108-4873-8ca5-7c6fa79c27a1 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.003860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 942/1867] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:34 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:35.011760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5346872-3629-487f-96e4-1a7e6a1f7ace admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.076874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:35.087268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b6b23-f108-4873-8ca5-7c6fa79c27a1 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.119893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5346872-3629-487f-96e4-1a7e6a1f7ace admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.124940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.125963 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.126346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.127016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.127815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.130242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.164306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 943/1868] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:35 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:35.165572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.167691 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.186619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac8bed-796b-4461-aaa1-1300b3cb30e3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.199421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.200785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.202116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.202557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] PATH_INFO: `/v3/projects/29ecc99db76446599656891ad3860f44` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.204053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ecc99db76446599656891ad3860f44)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.205983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.209681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.209894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:35.209991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.209991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.210319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.211011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.213086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.242804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 926/1869] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:34 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:35.243796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.245969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.258231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359d1de-a366-44b1-b548-69d232c52f31 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.266615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ecc99db76446599656891ad3860f44', 'request_id': 'req-b78e06b2-84eb-42bd-b293-0d556cfa4efd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.272330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ecc99db76446599656891ad3860f44', 'request_id': 'req-b78e06b2-84eb-42bd-b293-0d556cfa4efd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.279499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ecc99db76446599656891ad3860f44', 'request_id': 'req-b78e06b2-84eb-42bd-b293-0d556cfa4efd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.293549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] The token cache is being invalidate because project 29ecc99db76446599656891ad3860f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:35.293864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.294525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.296105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 944/1870] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:35 2022] DELETE /identity/v3/projects/29ecc99db76446599656891ad3860f44 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:35.297380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.298812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.317707 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.318640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.318924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.319207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] PATH_INFO: `/v3/projects/401d68f5707f4cc986917683a17ca452` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.320410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=401d68f5707f4cc986917683a17ca452)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.322391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.362754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e06b2-84eb-42bd-b293-0d556cfa4efd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.369478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401d68f5707f4cc986917683a17ca452', 'request_id': 'req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.375427 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401d68f5707f4cc986917683a17ca452', 'request_id': 'req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.381668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401d68f5707f4cc986917683a17ca452', 'request_id': 'req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.395101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] The token cache is being invalidate because project 401d68f5707f4cc986917683a17ca452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:35.395385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.396014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.397596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 927/1871] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:35 2022] DELETE /identity/v3/projects/401d68f5707f4cc986917683a17ca452 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:35.398492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.399769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.420887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.421683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.422016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.422300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.423185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.424853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.426979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:35.435505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 945/1872] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:35.436333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.438455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.451555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c56e64-656a-45ec-8806-841686fe08ad admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.456527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.457706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.458028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.458299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] PATH_INFO: `/v3/users/51c026a37a604f0d820cefbb4ea44624` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.459531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c026a37a604f0d820cefbb4ea44624)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.461452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.468952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f753e1e-803f-46f3-91c4-1da9b73ccb2f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.473659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7309bdb-aef4-4a74-9fb4-e347fbddf926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.474371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7309bdb-aef4-4a74-9fb4-e347fbddf926 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.474652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7309bdb-aef4-4a74-9fb4-e347fbddf926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.474898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7309bdb-aef4-4a74-9fb4-e347fbddf926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.475629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7309bdb-aef4-4a74-9fb4-e347fbddf926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.477239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7309bdb-aef4-4a74-9fb4-e347fbddf926 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.488166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 928/1873] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:35.489476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e95e6c-8812-4248-aeb2-afd65b384627 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.489853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e95e6c-8812-4248-aeb2-afd65b384627 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.490139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e95e6c-8812-4248-aeb2-afd65b384627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.500216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:35.509099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-91e95e6c-8812-4248-aeb2-afd65b384627 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:35.510477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-91e95e6c-8812-4248-aeb2-afd65b384627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.515995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c026a37a604f0d820cefbb4ea44624'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.516686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c026a37a604f0d820cefbb4ea44624'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.518819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 929/1874] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:35.519719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e95e6c-8812-4248-aeb2-afd65b384627 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.520980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-91e95e6c-8812-4248-aeb2-afd65b384627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.533984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c026a37a604f0d820cefbb4ea44624'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.534711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e95e6c-8812-4248-aeb2-afd65b384627 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.540064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.540737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.541014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.541281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.542029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c026a37a604f0d820cefbb4ea44624'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.542130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.543644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.554289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f3445f5-87ef-4faf-8afd-d3813d5c1d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c026a37a604f0d820cefbb4ea44624'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:35.554425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 930/1875] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:35.555267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.557060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.562585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 946/1876] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:35 2022] DELETE /identity/v3/users/51c026a37a604f0d820cefbb4ea44624 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:35.564293 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605d2f-48ef-4a91-bdaa-50237a352dd7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.564578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605d2f-48ef-4a91-bdaa-50237a352dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.564868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d605d2f-48ef-4a91-bdaa-50237a352dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.574129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689156c-a17d-4834-81e9-2a70b3070b45 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.582636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1d605d2f-48ef-4a91-bdaa-50237a352dd7 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:35.583914 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1d605d2f-48ef-4a91-bdaa-50237a352dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.637592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.638576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.638854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.639126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.639946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.641762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.654328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 931/1877] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:35.655106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.656740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.659748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 947/1878] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:35.660660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d605d2f-48ef-4a91-bdaa-50237a352dd7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.669598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e90c6-1e74-4c71-b7f8-63f580978ad8 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.673016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d605d2f-48ef-4a91-bdaa-50237a352dd7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.675016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947837e3-8d60-4b5e-aee1-e185af6f44de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.675955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947837e3-8d60-4b5e-aee1-e185af6f44de admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.676239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947837e3-8d60-4b5e-aee1-e185af6f44de admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.676516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947837e3-8d60-4b5e-aee1-e185af6f44de admin admin] PATH_INFO: `/v3/projects/a7c4516bcce046a388e8c5339310619e/users/5ffc81d90fd04e35aab60fd3bc510bfa/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.678179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d9ba-a89e-4502-b038-5e58d97528f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.679078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d9ba-a89e-4502-b038-5e58d97528f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.679363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d9ba-a89e-4502-b038-5e58d97528f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.679765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d9ba-a89e-4502-b038-5e58d97528f0 admin admin] PATH_INFO: `/v3/projects/ce7459c1f6314a32a20974ed2bb93741/users/8985211d0de74cb5bfb998cdfbe9e77c/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.694780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947837e3-8d60-4b5e-aee1-e185af6f44de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c4516bcce046a388e8c5339310619e, user_id=5ffc81d90fd04e35aab60fd3bc510bfa, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.698498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0d9ba-a89e-4502-b038-5e58d97528f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7459c1f6314a32a20974ed2bb93741, user_id=8985211d0de74cb5bfb998cdfbe9e77c, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.700434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947837e3-8d60-4b5e-aee1-e185af6f44de admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.701454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0d9ba-a89e-4502-b038-5e58d97528f0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.722563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 948/1879] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:35 2022] PUT /identity/v3/projects/ce7459c1f6314a32a20974ed2bb93741/users/8985211d0de74cb5bfb998cdfbe9e77c/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:35.724814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d9ba-a89e-4502-b038-5e58d97528f0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.734220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 932/1880] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:35 2022] PUT /identity/v3/projects/a7c4516bcce046a388e8c5339310619e/users/5ffc81d90fd04e35aab60fd3bc510bfa/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:35.746497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a71cb2-d0bd-459f-9a63-a0f989fdac22 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.746956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a71cb2-d0bd-459f-9a63-a0f989fdac22 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.747245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a71cb2-d0bd-459f-9a63-a0f989fdac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.782134 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-93a71cb2-d0bd-459f-9a63-a0f989fdac22 None None] MFA Rules not processed for user `8985211d0de74cb5bfb998cdfbe9e77c`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:35.783514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-93a71cb2-d0bd-459f-9a63-a0f989fdac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.829555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d9ba-a89e-4502-b038-5e58d97528f0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.834543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc4978-10aa-48a9-9d45-8843ae921e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.835230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc4978-10aa-48a9-9d45-8843ae921e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.835509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc4978-10aa-48a9-9d45-8843ae921e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.835784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc4978-10aa-48a9-9d45-8843ae921e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.836519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc4978-10aa-48a9-9d45-8843ae921e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:35.836823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc4978-10aa-48a9-9d45-8843ae921e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.838511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc4978-10aa-48a9-9d45-8843ae921e35 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.851924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 949/1881] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:35.853479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106964e1-91bc-47ae-918c-a46ae9cc235c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.853771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106964e1-91bc-47ae-918c-a46ae9cc235c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.854088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106964e1-91bc-47ae-918c-a46ae9cc235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.881930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 933/1882] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:35.882828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a71cb2-d0bd-459f-9a63-a0f989fdac22 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.890127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-106964e1-91bc-47ae-918c-a46ae9cc235c None None] MFA Rules not processed for user `5ffc81d90fd04e35aab60fd3bc510bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:35.890663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:35.891315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-106964e1-91bc-47ae-918c-a46ae9cc235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:35.897365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:35.899088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a71cb2-d0bd-459f-9a63-a0f989fdac22 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:35.917216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8512e65-f11f-4722-a368-65d5f4b81049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:35.917216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512e65-f11f-4722-a368-65d5f4b81049 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:35.917216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512e65-f11f-4722-a368-65d5f4b81049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:35.917216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8512e65-f11f-4722-a368-65d5f4b81049 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:35.918184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8512e65-f11f-4722-a368-65d5f4b81049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:35.918184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8512e65-f11f-4722-a368-65d5f4b81049 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:35.952517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 934/1883] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:35 2022] POST /identity/v3/projects => generated 357 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:35.952517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8512e65-f11f-4722-a368-65d5f4b81049 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.967861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 950/1884] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:35.972781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106964e1-91bc-47ae-918c-a46ae9cc235c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:35.985103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106964e1-91bc-47ae-918c-a46ae9cc235c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.021003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8512e65-f11f-4722-a368-65d5f4b81049 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.025971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2f0e-74f4-4da4-9aeb-bb60fb7c8266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.026746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2f0e-74f4-4da4-9aeb-bb60fb7c8266 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.027106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2f0e-74f4-4da4-9aeb-bb60fb7c8266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.027451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2f0e-74f4-4da4-9aeb-bb60fb7c8266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.028216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c2f0e-74f4-4da4-9aeb-bb60fb7c8266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.030243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c2f0e-74f4-4da4-9aeb-bb60fb7c8266 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.052616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07fd8f-08d6-4108-a842-4b4f93b1d1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.053338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fd8f-08d6-4108-a842-4b4f93b1d1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.053623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fd8f-08d6-4108-a842-4b4f93b1d1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.054129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fd8f-08d6-4108-a842-4b4f93b1d1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.054718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07fd8f-08d6-4108-a842-4b4f93b1d1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.056843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07fd8f-08d6-4108-a842-4b4f93b1d1a5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.064987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 935/1885] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:35 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:36.064987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2f0e-74f4-4da4-9aeb-bb60fb7c8266 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.087547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 951/1886] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:35 2022] POST /identity/v3/users => generated 279 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:36.091349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07fd8f-08d6-4108-a842-4b4f93b1d1a5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.102359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07fd8f-08d6-4108-a842-4b4f93b1d1a5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.138789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2f0e-74f4-4da4-9aeb-bb60fb7c8266 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.144370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8bb9f-e53c-43c5-ad03-7596e03c3e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.144976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8bb9f-e53c-43c5-ad03-7596e03c3e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.145256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8bb9f-e53c-43c5-ad03-7596e03c3e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.145581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8bb9f-e53c-43c5-ad03-7596e03c3e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.146315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8bb9f-e53c-43c5-ad03-7596e03c3e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.148425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8bb9f-e53c-43c5-ad03-7596e03c3e74 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.167838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dde27-0677-4ee1-a236-ebed4a3638ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.168544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dde27-0677-4ee1-a236-ebed4a3638ed admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.168823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dde27-0677-4ee1-a236-ebed4a3638ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.169040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dde27-0677-4ee1-a236-ebed4a3638ed admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.169811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dde27-0677-4ee1-a236-ebed4a3638ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.171810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dde27-0677-4ee1-a236-ebed4a3638ed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.191488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 936/1887] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:36.192385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8bb9f-e53c-43c5-ad03-7596e03c3e74 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.200751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 952/1888] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:36.201599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dde27-0677-4ee1-a236-ebed4a3638ed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.213029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dde27-0677-4ee1-a236-ebed4a3638ed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.243646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:36.280734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:36.295532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8bb9f-e53c-43c5-ad03-7596e03c3e74 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.313400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2104ba-92ea-44aa-9da6-c3a4a1def4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.315295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2104ba-92ea-44aa-9da6-c3a4a1def4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.315576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2104ba-92ea-44aa-9da6-c3a4a1def4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.316234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2104ba-92ea-44aa-9da6-c3a4a1def4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.316991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2104ba-92ea-44aa-9da6-c3a4a1def4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.319375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2104ba-92ea-44aa-9da6-c3a4a1def4f0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.320590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.321278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.321686 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.322070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.322788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.325575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.345132 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 937/1889] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:36.346158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2104ba-92ea-44aa-9da6-c3a4a1def4f0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.358135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 953/1890] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:36.359135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.361925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2104ba-92ea-44aa-9da6-c3a4a1def4f0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.362213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.367643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127eb55-b025-4ab5-9fd1-45b43323d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.368479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127eb55-b025-4ab5-9fd1-45b43323d6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.368967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127eb55-b025-4ab5-9fd1-45b43323d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.369384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127eb55-b025-4ab5-9fd1-45b43323d6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.371038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127eb55-b025-4ab5-9fd1-45b43323d6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.372669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127eb55-b025-4ab5-9fd1-45b43323d6e6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.378692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f507-e236-4def-bd18-f162fcd8cf85 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.384798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 938/1891] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:36.385684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127eb55-b025-4ab5-9fd1-45b43323d6e6 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.386608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.388698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.389231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.389844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] PATH_INFO: `/v3/projects/8951d66e7d7b48c08f36bb799c2f69b3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.392473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8951d66e7d7b48c08f36bb799c2f69b3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.397176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127eb55-b025-4ab5-9fd1-45b43323d6e6 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.397977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.402790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc59b-e8a3-458c-823f-679455692b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.403477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc59b-e8a3-458c-823f-679455692b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.403759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc59b-e8a3-458c-823f-679455692b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.404034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc59b-e8a3-458c-823f-679455692b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.405182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc59b-e8a3-458c-823f-679455692b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.406481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc59b-e8a3-458c-823f-679455692b12 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.420836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 939/1892] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:36.420836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc59b-e8a3-458c-823f-679455692b12 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.429498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc59b-e8a3-458c-823f-679455692b12 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.434667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522574f2-7045-4dcd-b85b-f45860d054d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.435411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522574f2-7045-4dcd-b85b-f45860d054d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.435696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522574f2-7045-4dcd-b85b-f45860d054d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.435992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522574f2-7045-4dcd-b85b-f45860d054d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.436732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522574f2-7045-4dcd-b85b-f45860d054d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.439524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522574f2-7045-4dcd-b85b-f45860d054d2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.450303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 940/1893] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:36.451362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522574f2-7045-4dcd-b85b-f45860d054d2 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.462531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522574f2-7045-4dcd-b85b-f45860d054d2 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.465048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8951d66e7d7b48c08f36bb799c2f69b3', 'request_id': 'req-03402b25-b4d3-4c5c-970b-3927d097c9e3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:36.471376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8951d66e7d7b48c08f36bb799c2f69b3', 'request_id': 'req-03402b25-b4d3-4c5c-970b-3927d097c9e3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:36.478293 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8951d66e7d7b48c08f36bb799c2f69b3', 'request_id': 'req-03402b25-b4d3-4c5c-970b-3927d097c9e3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:36.492672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] The token cache is being invalidate because project 8951d66e7d7b48c08f36bb799c2f69b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:36.493029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:36.494307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:36.495985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 954/1894] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:36 2022] DELETE /identity/v3/projects/8951d66e7d7b48c08f36bb799c2f69b3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:36.496735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.498076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.522518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.523201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.523531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.523841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.524551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.526171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.538551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 941/1895] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:36.539469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.541185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.553660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66a7b9-940d-4a6b-b570-01ad481bfb62 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.558315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29106514-8a3f-4927-94b1-98f6254f3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.559205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29106514-8a3f-4927-94b1-98f6254f3b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.559618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29106514-8a3f-4927-94b1-98f6254f3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.559897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29106514-8a3f-4927-94b1-98f6254f3b53 admin admin] PATH_INFO: `/v3/projects/bf32d9c1b39e4703b52e44cdff6d2e72/users/80e60322b40e47f0a12dd416767befdb/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.566254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402b25-b4d3-4c5c-970b-3927d097c9e3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.571983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.572878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.573197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.573511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] PATH_INFO: `/v3/projects/53504a5c5e3149c897114da1864e109c/users/d571990a1f4c4225ba9e23304bdc835f/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.575252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29106514-8a3f-4927-94b1-98f6254f3b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf32d9c1b39e4703b52e44cdff6d2e72, user_id=80e60322b40e47f0a12dd416767befdb, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.577978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29106514-8a3f-4927-94b1-98f6254f3b53 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.589003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53504a5c5e3149c897114da1864e109c, user_id=d571990a1f4c4225ba9e23304bdc835f, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.591728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.592559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 942/1896] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:36 2022] PUT /identity/v3/projects/bf32d9c1b39e4703b52e44cdff6d2e72/users/80e60322b40e47f0a12dd416767befdb/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:36.595619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d6037-d8e6-4a99-872a-c7ad269be78c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.595619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d6037-d8e6-4a99-872a-c7ad269be78c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.595619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d6037-d8e6-4a99-872a-c7ad269be78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.608062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 955/1897] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:36 2022] PUT /identity/v3/projects/53504a5c5e3149c897114da1864e109c/users/d571990a1f4c4225ba9e23304bdc835f/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:36.608859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.610596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.613228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b00d6037-d8e6-4a99-872a-c7ad269be78c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:36.614435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b00d6037-d8e6-4a99-872a-c7ad269be78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.637031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:36.675725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 943/1898] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:36.675910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9f5fe-b881-45ec-bbd8-91966902ba30 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.676467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d6037-d8e6-4a99-872a-c7ad269be78c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.681531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dea12-40b4-41bf-8956-6b4b5d9eb800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.682558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dea12-40b4-41bf-8956-6b4b5d9eb800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.682844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dea12-40b4-41bf-8956-6b4b5d9eb800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.683160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dea12-40b4-41bf-8956-6b4b5d9eb800 admin admin] PATH_INFO: `/v3/projects/b3248112ec8d45c39059247f579cd018/users/66cac324f619468ba98c121b73566f39/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.694268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d6037-d8e6-4a99-872a-c7ad269be78c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.699804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365ef06-a38f-434e-a19f-d0454caa3788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.700485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365ef06-a38f-434e-a19f-d0454caa3788 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.700768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365ef06-a38f-434e-a19f-d0454caa3788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.701041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365ef06-a38f-434e-a19f-d0454caa3788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.701144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dea12-40b4-41bf-8956-6b4b5d9eb800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3248112ec8d45c39059247f579cd018, user_id=66cac324f619468ba98c121b73566f39, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.701773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365ef06-a38f-434e-a19f-d0454caa3788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.703408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365ef06-a38f-434e-a19f-d0454caa3788 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.703850 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dea12-40b4-41bf-8956-6b4b5d9eb800 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.717881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 944/1899] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:36.717881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750493c-4183-4129-a358-1b8677a5423c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.717881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750493c-4183-4129-a358-1b8677a5423c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.717881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750493c-4183-4129-a358-1b8677a5423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.718406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 956/1900] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:36 2022] PUT /identity/v3/projects/b3248112ec8d45c39059247f579cd018/users/66cac324f619468ba98c121b73566f39/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:36.719922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de2c7-f6d6-4b8c-acd8-25246dfd6be6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.720172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de2c7-f6d6-4b8c-acd8-25246dfd6be6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.720452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de2c7-f6d6-4b8c-acd8-25246dfd6be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.740122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a55de2c7-f6d6-4b8c-acd8-25246dfd6be6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:36.741435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a55de2c7-f6d6-4b8c-acd8-25246dfd6be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.744099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d750493c-4183-4129-a358-1b8677a5423c None None] MFA Rules not processed for user `d571990a1f4c4225ba9e23304bdc835f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:36.745274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d750493c-4183-4129-a358-1b8677a5423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.750465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:36.801783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 957/1901] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:36.805820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de2c7-f6d6-4b8c-acd8-25246dfd6be6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.811646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 945/1902] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:36.812676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0937b1-b020-4796-b5ff-762f85fc2c03 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.812967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0937b1-b020-4796-b5ff-762f85fc2c03 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.813569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0937b1-b020-4796-b5ff-762f85fc2c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.816526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de2c7-f6d6-4b8c-acd8-25246dfd6be6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.821402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f708f8a-864e-4121-a704-443f988d29f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.822329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f708f8a-864e-4121-a704-443f988d29f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.822611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f708f8a-864e-4121-a704-443f988d29f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.822882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f708f8a-864e-4121-a704-443f988d29f6 admin admin] PATH_INFO: `/v3/projects/bf32d9c1b39e4703b52e44cdff6d2e72/users/80e60322b40e47f0a12dd416767befdb/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.824852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f708f8a-864e-4121-a704-443f988d29f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf32d9c1b39e4703b52e44cdff6d2e72, user_id=80e60322b40e47f0a12dd416767befdb, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.827520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f708f8a-864e-4121-a704-443f988d29f6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.838534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 958/1903] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:36 2022] PUT /identity/v3/projects/bf32d9c1b39e4703b52e44cdff6d2e72/users/80e60322b40e47f0a12dd416767befdb/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:36.839167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-5e0937b1-b020-4796-b5ff-762f85fc2c03 None None] MFA Rules not processed for user `66cac324f619468ba98c121b73566f39`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:36.839301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f708f8a-864e-4121-a704-443f988d29f6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.840467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5e0937b1-b020-4796-b5ff-762f85fc2c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.902564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f708f8a-864e-4121-a704-443f988d29f6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.909005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 946/1904] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:36.909005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0937b1-b020-4796-b5ff-762f85fc2c03 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.909595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3352fe-3f3f-4260-8073-0706e7df0737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.909595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3352fe-3f3f-4260-8073-0706e7df0737 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.909595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3352fe-3f3f-4260-8073-0706e7df0737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.909595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3352fe-3f3f-4260-8073-0706e7df0737 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.910246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3352fe-3f3f-4260-8073-0706e7df0737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:36.910246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3352fe-3f3f-4260-8073-0706e7df0737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.911460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3352fe-3f3f-4260-8073-0706e7df0737 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.920397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0937b1-b020-4796-b5ff-762f85fc2c03 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:36.927594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 959/1905] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:36.927594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98662a-eda3-4e55-9d0f-4514b40fa2a1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.927594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98662a-eda3-4e55-9d0f-4514b40fa2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.927594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98662a-eda3-4e55-9d0f-4514b40fa2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.928905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce09d-7b04-426a-a8ab-9c20bed1929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:36.929579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce09d-7b04-426a-a8ab-9c20bed1929e admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:36.929966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce09d-7b04-426a-a8ab-9c20bed1929e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:36.930205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce09d-7b04-426a-a8ab-9c20bed1929e admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:36.930839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce09d-7b04-426a-a8ab-9c20bed1929e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:36.933105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce09d-7b04-426a-a8ab-9c20bed1929e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:36.958463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5d98662a-eda3-4e55-9d0f-4514b40fa2a1 None None] MFA Rules not processed for user `80e60322b40e47f0a12dd416767befdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:36.960321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5d98662a-eda3-4e55-9d0f-4514b40fa2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:36.965851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 947/1906] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/projects => generated 357 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:36.965851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce09d-7b04-426a-a8ab-9c20bed1929e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:36.977129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:37.039651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce09d-7b04-426a-a8ab-9c20bed1929e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.046740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7623-8461-4c09-af56-5f80eead819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.047536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7623-8461-4c09-af56-5f80eead819d admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.047882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7623-8461-4c09-af56-5f80eead819d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.048335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7623-8461-4c09-af56-5f80eead819d admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.049276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e7623-8461-4c09-af56-5f80eead819d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.051369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e7623-8461-4c09-af56-5f80eead819d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.053640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 960/1907] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:37.054303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98662a-eda3-4e55-9d0f-4514b40fa2a1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.076149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98662a-eda3-4e55-9d0f-4514b40fa2a1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.081394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.082174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.082453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.082732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.083439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.085478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.085785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:37.099387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 948/1908] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:36 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:37.101160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7623-8461-4c09-af56-5f80eead819d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.117056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 961/1909] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:37 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:37.118069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.119812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:37.168257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7623-8461-4c09-af56-5f80eead819d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.180659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258943aa-df37-4126-b762-0ac87cbf8b6c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.184441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500fd1-3e51-4d93-9699-f8b19701e955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.185115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500fd1-3e51-4d93-9699-f8b19701e955 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.185392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500fd1-3e51-4d93-9699-f8b19701e955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.185663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500fd1-3e51-4d93-9699-f8b19701e955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.224592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832954d-1938-455e-8344-3b0c36a07d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.225273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832954d-1938-455e-8344-3b0c36a07d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.225551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832954d-1938-455e-8344-3b0c36a07d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.225817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832954d-1938-455e-8344-3b0c36a07d0a admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.226522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832954d-1938-455e-8344-3b0c36a07d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.228444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832954d-1938-455e-8344-3b0c36a07d0a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.250373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad500fd1-3e51-4d93-9699-f8b19701e955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.251980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad500fd1-3e51-4d93-9699-f8b19701e955 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.257299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 949/1910] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:37 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:37.257299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832954d-1938-455e-8344-3b0c36a07d0a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.261840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 962/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:37.262696 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500fd1-3e51-4d93-9699-f8b19701e955 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.265844 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832954d-1938-455e-8344-3b0c36a07d0a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.271391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde569b1-f908-4834-9e0f-869b31eccecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.272070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde569b1-f908-4834-9e0f-869b31eccecf admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.272403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde569b1-f908-4834-9e0f-869b31eccecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.272756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500fd1-3e51-4d93-9699-f8b19701e955 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.272863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde569b1-f908-4834-9e0f-869b31eccecf admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.273535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde569b1-f908-4834-9e0f-869b31eccecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.276028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde569b1-f908-4834-9e0f-869b31eccecf admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.283400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3d00e-791d-428d-9e07-31c915bc1b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.283400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d00e-791d-428d-9e07-31c915bc1b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.283400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d00e-791d-428d-9e07-31c915bc1b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.283400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d00e-791d-428d-9e07-31c915bc1b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.283734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3d00e-791d-428d-9e07-31c915bc1b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.283734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3d00e-791d-428d-9e07-31c915bc1b57 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.309763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 963/1912] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:37 2022] POST /identity/v3/users => generated 280 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:37.309763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3d00e-791d-428d-9e07-31c915bc1b57 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.311129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 950/1913] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:37 2022] POST /identity/v3/users => generated 300 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:37.312382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde569b1-f908-4834-9e0f-869b31eccecf admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.320486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3d00e-791d-428d-9e07-31c915bc1b57 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.325279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde569b1-f908-4834-9e0f-869b31eccecf admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.326131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3066bb-da64-47a9-a864-82a7054115a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.326870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3066bb-da64-47a9-a864-82a7054115a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.327216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3066bb-da64-47a9-a864-82a7054115a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.327632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3066bb-da64-47a9-a864-82a7054115a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.328351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3066bb-da64-47a9-a864-82a7054115a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.330162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf837166-8344-467a-b2fa-246ef17942a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.331013 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf837166-8344-467a-b2fa-246ef17942a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.331125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3066bb-da64-47a9-a864-82a7054115a1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.331295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf837166-8344-467a-b2fa-246ef17942a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.331568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf837166-8344-467a-b2fa-246ef17942a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.332299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf837166-8344-467a-b2fa-246ef17942a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.333982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf837166-8344-467a-b2fa-246ef17942a0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.346080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 951/1914] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:37.349289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf837166-8344-467a-b2fa-246ef17942a0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.350057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 964/1915] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:37.351084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3066bb-da64-47a9-a864-82a7054115a1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.359813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf837166-8344-467a-b2fa-246ef17942a0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.365504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3066bb-da64-47a9-a864-82a7054115a1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.367343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bcb21-8134-45fe-aeae-6e6d0e70b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.368021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bcb21-8134-45fe-aeae-6e6d0e70b8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.368306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bcb21-8134-45fe-aeae-6e6d0e70b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.368574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bcb21-8134-45fe-aeae-6e6d0e70b8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.369302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bcb21-8134-45fe-aeae-6e6d0e70b8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.370311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.371015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bcb21-8134-45fe-aeae-6e6d0e70b8b5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.371443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.371804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.372140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] PATH_INFO: `/v3/projects/94f8be37e854470c8de91d23a0a9fe98/users/65830a208e51493d9bd398dc89277368/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.381249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:37.383297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 952/1916] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:37.384195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bcb21-8134-45fe-aeae-6e6d0e70b8b5 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.388871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f8be37e854470c8de91d23a0a9fe98, user_id=65830a208e51493d9bd398dc89277368, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.391656 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.394468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bcb21-8134-45fe-aeae-6e6d0e70b8b5 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.399776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c05fb2-828b-4968-8435-6331f6729f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.400665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05fb2-828b-4968-8435-6331f6729f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.400942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05fb2-828b-4968-8435-6331f6729f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.401211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c05fb2-828b-4968-8435-6331f6729f4f admin admin] PATH_INFO: `/v3/projects/6597c9e7f6f440d09625d00ef85f63e1/users/d5e135128aec4cbe9f3868b269fbc6c7/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.408356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 965/1917] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:37 2022] PUT /identity/v3/projects/94f8be37e854470c8de91d23a0a9fe98/users/65830a208e51493d9bd398dc89277368/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:37.411217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.413160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:37.417671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05fb2-828b-4968-8435-6331f6729f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6597c9e7f6f440d09625d00ef85f63e1, user_id=d5e135128aec4cbe9f3868b269fbc6c7, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.420509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c05fb2-828b-4968-8435-6331f6729f4f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.438193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 953/1918] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:37 2022] PUT /identity/v3/projects/6597c9e7f6f440d09625d00ef85f63e1/users/d5e135128aec4cbe9f3868b269fbc6c7/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:37.442801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c05fb2-828b-4968-8435-6331f6729f4f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.483230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:37.483445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eb18b-d51c-4e4e-af32-f5129b566518 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.526926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c05fb2-828b-4968-8435-6331f6729f4f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.534807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967927-1dab-4356-97dc-2bd4ec6d77a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.535988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967927-1dab-4356-97dc-2bd4ec6d77a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.536417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967927-1dab-4356-97dc-2bd4ec6d77a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.536832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46967927-1dab-4356-97dc-2bd4ec6d77a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.537588 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46967927-1dab-4356-97dc-2bd4ec6d77a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.539369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46967927-1dab-4356-97dc-2bd4ec6d77a9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.541157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.541874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.542135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.542455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.544993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:37.554177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 954/1919] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:37.555434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967927-1dab-4356-97dc-2bd4ec6d77a9 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.572191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46967927-1dab-4356-97dc-2bd4ec6d77a9 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.584060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f57a3-7a9a-4bcd-a149-8fe534b76c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.585014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f57a3-7a9a-4bcd-a149-8fe534b76c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.585327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f57a3-7a9a-4bcd-a149-8fe534b76c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.585934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f57a3-7a9a-4bcd-a149-8fe534b76c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.586855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f57a3-7a9a-4bcd-a149-8fe534b76c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.589432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f57a3-7a9a-4bcd-a149-8fe534b76c35 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.611856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 955/1920] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:37.611856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f57a3-7a9a-4bcd-a149-8fe534b76c35 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.620545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f57a3-7a9a-4bcd-a149-8fe534b76c35 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.625032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.625776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15ae4-1dfb-4c45-bf22-02f4420c8668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.626865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15ae4-1dfb-4c45-bf22-02f4420c8668 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.626975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.627053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15ae4-1dfb-4c45-bf22-02f4420c8668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.627053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15ae4-1dfb-4c45-bf22-02f4420c8668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.627730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15ae4-1dfb-4c45-bf22-02f4420c8668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.629327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15ae4-1dfb-4c45-bf22-02f4420c8668 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.642266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 956/1921] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:37.642596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15ae4-1dfb-4c45-bf22-02f4420c8668 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.644240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 966/1922] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:37.644944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.652327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15ae4-1dfb-4c45-bf22-02f4420c8668 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.657043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb53ec-7b97-4771-960a-6184f556a207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.658054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb53ec-7b97-4771-960a-6184f556a207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.658335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb53ec-7b97-4771-960a-6184f556a207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.658723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb53ec-7b97-4771-960a-6184f556a207 admin admin] PATH_INFO: `/v3/projects/a4bcd0a89902481f8e7fb48f6cf0f368/users/d1e2df3d0dd544aa85c23f9143b25fbb/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.659519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe0bb9-ce33-4686-9ccb-86b05891a0c9 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.664974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624414-0fe0-44e9-a0e0-62db6d797721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.665892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624414-0fe0-44e9-a0e0-62db6d797721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.666174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624414-0fe0-44e9-a0e0-62db6d797721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.666446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624414-0fe0-44e9-a0e0-62db6d797721 admin admin] PATH_INFO: `/v3/projects/94f8be37e854470c8de91d23a0a9fe98/users/65830a208e51493d9bd398dc89277368/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.668513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4624414-0fe0-44e9-a0e0-62db6d797721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f8be37e854470c8de91d23a0a9fe98, user_id=65830a208e51493d9bd398dc89277368, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.671586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4624414-0fe0-44e9-a0e0-62db6d797721 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.674685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb53ec-7b97-4771-960a-6184f556a207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bcd0a89902481f8e7fb48f6cf0f368, user_id=d1e2df3d0dd544aa85c23f9143b25fbb, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.677496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb53ec-7b97-4771-960a-6184f556a207 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.685849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 967/1923] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:37 2022] PUT /identity/v3/projects/94f8be37e854470c8de91d23a0a9fe98/users/65830a208e51493d9bd398dc89277368/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:37.685849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624414-0fe0-44e9-a0e0-62db6d797721 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.711129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 957/1924] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:37 2022] PUT /identity/v3/projects/a4bcd0a89902481f8e7fb48f6cf0f368/users/d1e2df3d0dd544aa85c23f9143b25fbb/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:37.712382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec414-9ab6-40d7-9f1d-abd115767f28 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.712734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec414-9ab6-40d7-9f1d-abd115767f28 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.713073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bec414-9ab6-40d7-9f1d-abd115767f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.741838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c1bec414-9ab6-40d7-9f1d-abd115767f28 None None] MFA Rules not processed for user `65830a208e51493d9bd398dc89277368`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:37.743139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c1bec414-9ab6-40d7-9f1d-abd115767f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:37.753736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:37.774208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624414-0fe0-44e9-a0e0-62db6d797721 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.823877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 958/1925] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:37.825256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6318-eddc-4ab9-adb9-0932e5059200 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.825546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6318-eddc-4ab9-adb9-0932e5059200 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.825913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e6318-eddc-4ab9-adb9-0932e5059200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.852338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d0ccf-fea6-4ad4-b151-ac1e579095b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.853454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d0ccf-fea6-4ad4-b151-ac1e579095b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.853942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d0ccf-fea6-4ad4-b151-ac1e579095b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.854838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d0ccf-fea6-4ad4-b151-ac1e579095b3 admin admin] PATH_INFO: `/v3/projects/6597c9e7f6f440d09625d00ef85f63e1/users/d5e135128aec4cbe9f3868b269fbc6c7/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.856679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d0ccf-fea6-4ad4-b151-ac1e579095b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6597c9e7f6f440d09625d00ef85f63e1, user_id=d5e135128aec4cbe9f3868b269fbc6c7, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:37.857870 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-3d6e6318-eddc-4ab9-adb9-0932e5059200 None None] MFA Rules not processed for user `d1e2df3d0dd544aa85c23f9143b25fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:37.859244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-3d6e6318-eddc-4ab9-adb9-0932e5059200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:37.859444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d0ccf-fea6-4ad4-b151-ac1e579095b3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:37.872306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 968/1926] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:37 2022] PUT /identity/v3/projects/6597c9e7f6f440d09625d00ef85f63e1/users/d5e135128aec4cbe9f3868b269fbc6c7/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:37.873280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d0ccf-fea6-4ad4-b151-ac1e579095b3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:37.932642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d0ccf-fea6-4ad4-b151-ac1e579095b3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:37.945061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcbce1-1e23-42c2-9807-b00e76b65c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:37.945061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbce1-1e23-42c2-9807-b00e76b65c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.945061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbce1-1e23-42c2-9807-b00e76b65c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.945061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcbce1-1e23-42c2-9807-b00e76b65c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.945386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:37.954049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 959/1927] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:37 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:37.954049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ffc-15a5-484e-84a5-5753db1e584b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:37.954049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ffc-15a5-484e-84a5-5753db1e584b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:37.954049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ffc-15a5-484e-84a5-5753db1e584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:37.988346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-04035ffc-15a5-484e-84a5-5753db1e584b None None] MFA Rules not processed for user `d5e135128aec4cbe9f3868b269fbc6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:37.998250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-04035ffc-15a5-484e-84a5-5753db1e584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:38.025239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcbce1-1e23-42c2-9807-b00e76b65c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:38.027000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcbce1-1e23-42c2-9807-b00e76b65c1c service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:38.038557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 969/1928] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:38.039614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcbce1-1e23-42c2-9807-b00e76b65c1c service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:38.049062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcbce1-1e23-42c2-9807-b00e76b65c1c service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:38.053353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc1b99-f994-4075-a5e1-233fe569c2b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:38.054210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1b99-f994-4075-a5e1-233fe569c2b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:38.054492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1b99-f994-4075-a5e1-233fe569c2b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:38.054768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc1b99-f994-4075-a5e1-233fe569c2b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:38.089542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 960/1929] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:37 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:38.104251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:38.137532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035ffc-15a5-484e-84a5-5753db1e584b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:38.138287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc1b99-f994-4075-a5e1-233fe569c2b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:38.139806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc1b99-f994-4075-a5e1-233fe569c2b8 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:38.148309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035ffc-15a5-484e-84a5-5753db1e584b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:38.149659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 970/1930] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:38.152222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971f36b-d01f-4483-a899-03b92df08823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:38.152968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f36b-d01f-4483-a899-03b92df08823 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:38.153317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f36b-d01f-4483-a899-03b92df08823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:38.153660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f36b-d01f-4483-a899-03b92df08823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:38.164935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc1b99-f994-4075-a5e1-233fe569c2b8 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:38.165100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971f36b-d01f-4483-a899-03b92df08823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:38.166797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971f36b-d01f-4483-a899-03b92df08823 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:38.177854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 961/1931] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:12:38.267540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc1b99-f994-4075-a5e1-233fe569c2b8 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:38.269495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971f36b-d01f-4483-a899-03b92df08823 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:38.272488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:38.273418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:38.273696 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:38.274005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] PATH_INFO: `/v3/users/d1e2df3d0dd544aa85c23f9143b25fbb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:38.275248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e2df3d0dd544aa85c23f9143b25fbb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:38.277931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:38.293706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971f36b-d01f-4483-a899-03b92df08823 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:38.306282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:38.307125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:38.307417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:38.307875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:38.334938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e2df3d0dd544aa85c23f9143b25fbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:38.335942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e2df3d0dd544aa85c23f9143b25fbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:38.346864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e2df3d0dd544aa85c23f9143b25fbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:38.355787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e2df3d0dd544aa85c23f9143b25fbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:38.368969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-62d3151d-699f-40f8-a9f7-ac37b789a2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e2df3d0dd544aa85c23f9143b25fbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:38.376379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 971/1932] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:38 2022] DELETE /identity/v3/users/d1e2df3d0dd544aa85c23f9143b25fbb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:12:38.381301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ca14-3ffe-4946-9042-6b7b7cc8cc13 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:38.381301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ca14-3ffe-4946-9042-6b7b7cc8cc13 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:38.381539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ca14-3ffe-4946-9042-6b7b7cc8cc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:38.382061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:38.383602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:38.393274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 962/1933] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:12:38.416789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0697ca14-3ffe-4946-9042-6b7b7cc8cc13 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:38.418790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0697ca14-3ffe-4946-9042-6b7b7cc8cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:38.475493 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:38.493068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 972/1934] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:38.503689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:38.505475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:38.593619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2caa9e-cc17-4c96-88e7-cd8b9caf1a0b service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:38.632477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:38.700333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:38.701094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:38.701452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:38.703479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:38.720349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:38.722581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:38.737540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 963/1935] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:38.799446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ca14-3ffe-4946-9042-6b7b7cc8cc13 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:38.801020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0697ca14-3ffe-4946-9042-6b7b7cc8cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:38.900018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ca14-3ffe-4946-9042-6b7b7cc8cc13 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:38.904153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bf26a-0362-4c05-ac21-00be1ecc68e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:38.904820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bf26a-0362-4c05-ac21-00be1ecc68e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:38.905104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bf26a-0362-4c05-ac21-00be1ecc68e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:38.905386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bf26a-0362-4c05-ac21-00be1ecc68e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:38.907275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-509bf26a-0362-4c05-ac21-00be1ecc68e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:38.976240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bf26a-0362-4c05-ac21-00be1ecc68e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:38.977767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bf26a-0362-4c05-ac21-00be1ecc68e0 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:38.989737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 973/1936] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:39.085872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:39.088270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:39.116396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6a4e4-fe2d-4f1d-baa9-b775cbb4ad34 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:39.124898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:39.125989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.126327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.126670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] PATH_INFO: `/v3/projects/a4bcd0a89902481f8e7fb48f6cf0f368` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.128520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4bcd0a89902481f8e7fb48f6cf0f368)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:39.130675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:39.188394 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4bcd0a89902481f8e7fb48f6cf0f368', 'request_id': 'req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:39.197897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4bcd0a89902481f8e7fb48f6cf0f368', 'request_id': 'req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:39.205068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4bcd0a89902481f8e7fb48f6cf0f368', 'request_id': 'req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:39.224580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] The token cache is being invalidate because project a4bcd0a89902481f8e7fb48f6cf0f368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:39.224761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:39.225501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8e66b3a8-42c9-4950-948b-ad6c9cfc99b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:39.227470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 964/1937] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:39 2022] DELETE /identity/v3/projects/a4bcd0a89902481f8e7fb48f6cf0f368 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:39.233361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775534-1bd6-4676-826e-82c80913fd49 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.233974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775534-1bd6-4676-826e-82c80913fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.234676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775534-1bd6-4676-826e-82c80913fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.254690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-07775534-1bd6-4676-826e-82c80913fd49 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:39.255913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-07775534-1bd6-4676-826e-82c80913fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:39.334029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 974/1938] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:39.341554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc798f-2445-42e4-bb16-f8d54a7cb426 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.341876 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc798f-2445-42e4-bb16-f8d54a7cb426 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.342161 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc798f-2445-42e4-bb16-f8d54a7cb426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.361971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-20bc798f-2445-42e4-bb16-f8d54a7cb426 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:39.363200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-20bc798f-2445-42e4-bb16-f8d54a7cb426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:39.375296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 965/1939] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:39.376238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775534-1bd6-4676-826e-82c80913fd49 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:39.386582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775534-1bd6-4676-826e-82c80913fd49 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:39.392280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:39.393000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.393229 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.393500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.394269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:39.394578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:39.396187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:39.412381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 975/1940] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:39.415001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc798f-2445-42e4-bb16-f8d54a7cb426 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:39.425700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc798f-2445-42e4-bb16-f8d54a7cb426 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:39.431547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d11f31-28e0-4b74-91c4-76c8ee30d236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:39.432496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11f31-28e0-4b74-91c4-76c8ee30d236 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.432785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11f31-28e0-4b74-91c4-76c8ee30d236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.433061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11f31-28e0-4b74-91c4-76c8ee30d236 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.433930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d11f31-28e0-4b74-91c4-76c8ee30d236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:39.435865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d11f31-28e0-4b74-91c4-76c8ee30d236 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:39.464311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 966/1941] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:39 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:39.468677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:39.479391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87592a3f-c592-4cf2-ae86-a892adce1a5b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:39.513507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:39.538883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3f2c-5922-4b25-81cb-750d3089bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:39.539572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3f2c-5922-4b25-81cb-750d3089bfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.539845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3f2c-5922-4b25-81cb-750d3089bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.540116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3f2c-5922-4b25-81cb-750d3089bfd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.540881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3f2c-5922-4b25-81cb-750d3089bfd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:39.542851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3f2c-5922-4b25-81cb-750d3089bfd3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:39.565024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 976/1942] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:39 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:12:39.569415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d11f31-28e0-4b74-91c4-76c8ee30d236 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:39.580464 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d11f31-28e0-4b74-91c4-76c8ee30d236 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:39.586201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe6156-8d9b-4a15-b4fd-95d933a9fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:39.586742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe6156-8d9b-4a15-b4fd-95d933a9fa76 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.587077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe6156-8d9b-4a15-b4fd-95d933a9fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.587368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe6156-8d9b-4a15-b4fd-95d933a9fa76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.588074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe6156-8d9b-4a15-b4fd-95d933a9fa76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:39.589735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe6156-8d9b-4a15-b4fd-95d933a9fa76 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:39.601036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 967/1943] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:39.605203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3f2c-5922-4b25-81cb-750d3089bfd3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:39.615739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3f2c-5922-4b25-81cb-750d3089bfd3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:39.620540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ea008-1846-4941-9731-2d7deb3807bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:39.621230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea008-1846-4941-9731-2d7deb3807bb admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.621507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea008-1846-4941-9731-2d7deb3807bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.621783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea008-1846-4941-9731-2d7deb3807bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.622552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ea008-1846-4941-9731-2d7deb3807bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:39.624116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ea008-1846-4941-9731-2d7deb3807bb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:39.634932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 977/1944] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:12:39.639205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe6156-8d9b-4a15-b4fd-95d933a9fa76 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:39.650062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe6156-8d9b-4a15-b4fd-95d933a9fa76 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:39.655467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:39.656353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.656630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.656913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] PATH_INFO: `/v3/projects/0c99ac56b91e4d5c88d6cf68aac43553/users/9092152890b643dfba02a1c4d99bd4d9/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.673800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c99ac56b91e4d5c88d6cf68aac43553, user_id=9092152890b643dfba02a1c4d99bd4d9, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:39.677031 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:39.701847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 968/1945] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:39 2022] PUT /identity/v3/projects/0c99ac56b91e4d5c88d6cf68aac43553/users/9092152890b643dfba02a1c4d99bd4d9/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:39.712877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5439a-4283-4ac5-a67f-ac7f90e78730 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.713221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5439a-4283-4ac5-a67f-ac7f90e78730 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.713509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5439a-4283-4ac5-a67f-ac7f90e78730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.744755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-09a5439a-4283-4ac5-a67f-ac7f90e78730 None None] MFA Rules not processed for user `9092152890b643dfba02a1c4d99bd4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:39.746205 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-09a5439a-4283-4ac5-a67f-ac7f90e78730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:39.813266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 978/1946] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:39.828792 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:39.831576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:39.919985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:39.928852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c5085-47c8-4db9-8a27-f5ca87d5ba17 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:39.934168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a3ded-5e31-4c04-941e-f55602279528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:39.935491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a3ded-5e31-4c04-941e-f55602279528 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:39.936152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a3ded-5e31-4c04-941e-f55602279528 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:39.936612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a3ded-5e31-4c04-941e-f55602279528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:39.949500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a3ded-5e31-4c04-941e-f55602279528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:39.951441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a3ded-5e31-4c04-941e-f55602279528 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:39.962257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 969/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:40.321338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5439a-4283-4ac5-a67f-ac7f90e78730 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:40.324086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-09a5439a-4283-4ac5-a67f-ac7f90e78730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:40.399334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5439a-4283-4ac5-a67f-ac7f90e78730 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:40.404050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:40.404930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:40.405206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:40.405473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] PATH_INFO: `/v3/users/5ffc81d90fd04e35aab60fd3bc510bfa` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:40.406979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ffc81d90fd04e35aab60fd3bc510bfa)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:40.408967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:40.455449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:40.457054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ffc81d90fd04e35aab60fd3bc510bfa'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:40.457830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ffc81d90fd04e35aab60fd3bc510bfa'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:40.467679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ffc81d90fd04e35aab60fd3bc510bfa'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:40.476016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ffc81d90fd04e35aab60fd3bc510bfa'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:40.488865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ffc81d90fd04e35aab60fd3bc510bfa'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:40.495322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 979/1948] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:40 2022] DELETE /identity/v3/users/5ffc81d90fd04e35aab60fd3bc510bfa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:40.500812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25ac5e-9ec9-43b5-8b60-49c80bed7232 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:40.501320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25ac5e-9ec9-43b5-8b60-49c80bed7232 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:40.501666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25ac5e-9ec9-43b5-8b60-49c80bed7232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:40.545189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-df25ac5e-9ec9-43b5-8b60-49c80bed7232 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:40.546572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-df25ac5e-9ec9-43b5-8b60-49c80bed7232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:40.611595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 970/1949] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:40.622450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:40.623938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:40.685075 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8772-a037-4303-9857-192d05e673d5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:40.694190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbd8b3-4b42-4228-88c9-16c17f6fc1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:40.694190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbd8b3-4b42-4228-88c9-16c17f6fc1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:40.694190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbd8b3-4b42-4228-88c9-16c17f6fc1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:40.694190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbd8b3-4b42-4228-88c9-16c17f6fc1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:40.700852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbd8b3-4b42-4228-88c9-16c17f6fc1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:40.702332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbd8b3-4b42-4228-88c9-16c17f6fc1f4 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:40.712047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 980/1950] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:12:40.993748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25ac5e-9ec9-43b5-8b60-49c80bed7232 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:40.995623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-df25ac5e-9ec9-43b5-8b60-49c80bed7232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:41.020139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25ac5e-9ec9-43b5-8b60-49c80bed7232 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:41.025760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:41.026866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:41.027224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:41.027627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] PATH_INFO: `/v3/projects/a7c4516bcce046a388e8c5339310619e` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:41.028955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c4516bcce046a388e8c5339310619e)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:41.031114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:41.135417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c4516bcce046a388e8c5339310619e', 'request_id': 'req-6f01d355-6b7f-401f-91f1-a160a20a37cd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.152020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c4516bcce046a388e8c5339310619e', 'request_id': 'req-6f01d355-6b7f-401f-91f1-a160a20a37cd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.198309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c4516bcce046a388e8c5339310619e', 'request_id': 'req-6f01d355-6b7f-401f-91f1-a160a20a37cd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.227684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] The token cache is being invalidate because project a7c4516bcce046a388e8c5339310619e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:41.228064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.229443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.232219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 971/1951] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:40 2022] DELETE /identity/v3/projects/a7c4516bcce046a388e8c5339310619e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:41.236756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbd8b3-4b42-4228-88c9-16c17f6fc1f4 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:41.251865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbd8b3-4b42-4228-88c9-16c17f6fc1f4 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:41.364905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:41.365907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:41.366199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:41.366477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] PATH_INFO: `/v3/users/80e60322b40e47f0a12dd416767befdb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:41.367704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e60322b40e47f0a12dd416767befdb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:41.369645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:41.433168 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e60322b40e47f0a12dd416767befdb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.434366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e60322b40e47f0a12dd416767befdb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.446387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e60322b40e47f0a12dd416767befdb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.456256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e60322b40e47f0a12dd416767befdb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.462109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:41.473915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3734b111-a08a-42cb-93f7-23fca1ef4966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e60322b40e47f0a12dd416767befdb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:41.481862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 981/1952] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:41 2022] DELETE /identity/v3/users/80e60322b40e47f0a12dd416767befdb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:41.874056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:41.875593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:41.898987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01d355-6b7f-401f-91f1-a160a20a37cd admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:41.975360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:41.976243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:41.976519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:41.976789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] PATH_INFO: `/v3/projects/bf32d9c1b39e4703b52e44cdff6d2e72` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:41.977995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf32d9c1b39e4703b52e44cdff6d2e72)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:41.979906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:41.996515 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:42.029266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf32d9c1b39e4703b52e44cdff6d2e72', 'request_id': 'req-133dc746-f3c9-4be1-8fc1-93d95869b645'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.035865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf32d9c1b39e4703b52e44cdff6d2e72', 'request_id': 'req-133dc746-f3c9-4be1-8fc1-93d95869b645'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.042462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf32d9c1b39e4703b52e44cdff6d2e72', 'request_id': 'req-133dc746-f3c9-4be1-8fc1-93d95869b645'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.058608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] The token cache is being invalidate because project bf32d9c1b39e4703b52e44cdff6d2e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:42.058828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.059443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-133dc746-f3c9-4be1-8fc1-93d95869b645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.061024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 972/1953] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:41 2022] DELETE /identity/v3/projects/bf32d9c1b39e4703b52e44cdff6d2e72 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:42.066694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed1c3-40a3-4f1b-aaed-6c6a131775e0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.066984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed1c3-40a3-4f1b-aaed-6c6a131775e0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.067263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed1c3-40a3-4f1b-aaed-6c6a131775e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.086010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b21ed1c3-40a3-4f1b-aaed-6c6a131775e0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:42.087232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b21ed1c3-40a3-4f1b-aaed-6c6a131775e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:42.148773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 982/1954] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:42.157375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb168dda-6d58-4e4e-8b2d-ca7b577beb4b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.157738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb168dda-6d58-4e4e-8b2d-ca7b577beb4b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.158059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb168dda-6d58-4e4e-8b2d-ca7b577beb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.178550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-eb168dda-6d58-4e4e-8b2d-ca7b577beb4b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:42.179761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-eb168dda-6d58-4e4e-8b2d-ca7b577beb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:42.190501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 973/1955] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:42.195521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed1c3-40a3-4f1b-aaed-6c6a131775e0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:42.211077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed1c3-40a3-4f1b-aaed-6c6a131775e0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:42.219031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:42.219778 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.220061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.220488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.221190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:42.221491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:42.223121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:42.235569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 983/1956] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:12:42.239900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb168dda-6d58-4e4e-8b2d-ca7b577beb4b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:42.250046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb168dda-6d58-4e4e-8b2d-ca7b577beb4b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:42.255638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b5fe-c5a8-452a-a244-4e3d64f34d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:42.256303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b5fe-c5a8-452a-a244-4e3d64f34d50 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.256586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b5fe-c5a8-452a-a244-4e3d64f34d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.256865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b5fe-c5a8-452a-a244-4e3d64f34d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.257574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b5fe-c5a8-452a-a244-4e3d64f34d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:42.259544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b5fe-c5a8-452a-a244-4e3d64f34d50 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:42.288140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 974/1957] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:42 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:42.292324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:42.303125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc127-11aa-4d97-826d-48da4ef2c228 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:42.367201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25babfa1-7879-487d-bbd9-9ef0aa4ab010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:42.367974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babfa1-7879-487d-bbd9-9ef0aa4ab010 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.368608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babfa1-7879-487d-bbd9-9ef0aa4ab010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.368608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babfa1-7879-487d-bbd9-9ef0aa4ab010 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.369354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25babfa1-7879-487d-bbd9-9ef0aa4ab010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:42.371430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25babfa1-7879-487d-bbd9-9ef0aa4ab010 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:42.399720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 984/1958] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:42 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:42.401029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b5fe-c5a8-452a-a244-4e3d64f34d50 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:42.415115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b5fe-c5a8-452a-a244-4e3d64f34d50 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:42.419940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27220cc3-e741-478e-8b5b-d732b5433864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:42.420616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27220cc3-e741-478e-8b5b-d732b5433864 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.421053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27220cc3-e741-478e-8b5b-d732b5433864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.421519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27220cc3-e741-478e-8b5b-d732b5433864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.422275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27220cc3-e741-478e-8b5b-d732b5433864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:42.424386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27220cc3-e741-478e-8b5b-d732b5433864 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:42.436708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 975/1959] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:42.441189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25babfa1-7879-487d-bbd9-9ef0aa4ab010 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:42.453693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25babfa1-7879-487d-bbd9-9ef0aa4ab010 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:42.458833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5a01c-05c5-43fa-9f83-98bb36487ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:42.459718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5a01c-05c5-43fa-9f83-98bb36487ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.460177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5a01c-05c5-43fa-9f83-98bb36487ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.461238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5a01c-05c5-43fa-9f83-98bb36487ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.462208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5a01c-05c5-43fa-9f83-98bb36487ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:42.464385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5a01c-05c5-43fa-9f83-98bb36487ec4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:42.476471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 985/1960] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:12:42.480406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27220cc3-e741-478e-8b5b-d732b5433864 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:42.492873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27220cc3-e741-478e-8b5b-d732b5433864 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:42.499846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:42.502862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.503384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.503901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] PATH_INFO: `/v3/projects/0bc9de2c716a4bea96785a39af9fbeec/users/aa9c5ada5aee4ca69d5f73e1f98401c8/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.523865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc9de2c716a4bea96785a39af9fbeec, user_id=aa9c5ada5aee4ca69d5f73e1f98401c8, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:42.527829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:42.562819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 976/1961] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:42 2022] PUT /identity/v3/projects/0bc9de2c716a4bea96785a39af9fbeec/users/aa9c5ada5aee4ca69d5f73e1f98401c8/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:42.574161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe105d1b-362e-4fe1-974b-c2ac030f4bca None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.574474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe105d1b-362e-4fe1-974b-c2ac030f4bca None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.574756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe105d1b-362e-4fe1-974b-c2ac030f4bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.610998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fe105d1b-362e-4fe1-974b-c2ac030f4bca None None] MFA Rules not processed for user `aa9c5ada5aee4ca69d5f73e1f98401c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:42.612298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fe105d1b-362e-4fe1-974b-c2ac030f4bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:42.662791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:42.697545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 986/1962] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:42.705406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:42.707248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:42.771250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94c102-f023-454d-ae9a-7f87d9550485 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:42.775184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f597ba5-e1e2-41dc-bab4-3eb2e1b44062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:42.775846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597ba5-e1e2-41dc-bab4-3eb2e1b44062 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.776128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597ba5-e1e2-41dc-bab4-3eb2e1b44062 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.776402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597ba5-e1e2-41dc-bab4-3eb2e1b44062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.785768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f597ba5-e1e2-41dc-bab4-3eb2e1b44062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:42.787278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f597ba5-e1e2-41dc-bab4-3eb2e1b44062 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:42.799873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 977/1963] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:42.820279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe105d1b-362e-4fe1-974b-c2ac030f4bca None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:42.892628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe105d1b-362e-4fe1-974b-c2ac030f4bca None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:42.898058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:42.898950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:42.899231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:42.899505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] PATH_INFO: `/v3/users/aa9c5ada5aee4ca69d5f73e1f98401c8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:42.900733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9c5ada5aee4ca69d5f73e1f98401c8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:42.902692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:42.963225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9c5ada5aee4ca69d5f73e1f98401c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.963944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9c5ada5aee4ca69d5f73e1f98401c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.972838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9c5ada5aee4ca69d5f73e1f98401c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.979897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9c5ada5aee4ca69d5f73e1f98401c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:42.995106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9c5ada5aee4ca69d5f73e1f98401c8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:43.001786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 987/1964] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:42 2022] DELETE /identity/v3/users/aa9c5ada5aee4ca69d5f73e1f98401c8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:43.006499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070da13-66b1-40cc-a82c-e9aa81d8d5f1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:43.006974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070da13-66b1-40cc-a82c-e9aa81d8d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:43.007133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070da13-66b1-40cc-a82c-e9aa81d8d5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:43.025678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f070da13-66b1-40cc-a82c-e9aa81d8d5f1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:43.026928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f070da13-66b1-40cc-a82c-e9aa81d8d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:43.066404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:43.093143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 978/1965] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:43.104184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:43.106558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:43.174351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707f12-9ed7-48cf-b23e-919db1d9b3e9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:43.179995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d182e-d62f-462e-8e98-d6698be24bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:43.180653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d182e-d62f-462e-8e98-d6698be24bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:43.180934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d182e-d62f-462e-8e98-d6698be24bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:43.181210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d182e-d62f-462e-8e98-d6698be24bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:43.193160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d182e-d62f-462e-8e98-d6698be24bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:43.194641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d182e-d62f-462e-8e98-d6698be24bf4 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:43.204790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 988/1966] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:43.501838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070da13-66b1-40cc-a82c-e9aa81d8d5f1 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:43.503804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f070da13-66b1-40cc-a82c-e9aa81d8d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:43.518657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070da13-66b1-40cc-a82c-e9aa81d8d5f1 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:43.524937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:43.526224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:43.526566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:43.526854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] PATH_INFO: `/v3/projects/0bc9de2c716a4bea96785a39af9fbeec` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:43.528418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc9de2c716a4bea96785a39af9fbeec)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:43.530701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:43.583735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc9de2c716a4bea96785a39af9fbeec', 'request_id': 'req-1de90873-b2fe-4470-a571-217a661369aa'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:43.590183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc9de2c716a4bea96785a39af9fbeec', 'request_id': 'req-1de90873-b2fe-4470-a571-217a661369aa'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:43.597942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc9de2c716a4bea96785a39af9fbeec', 'request_id': 'req-1de90873-b2fe-4470-a571-217a661369aa'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:43.618351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] The token cache is being invalidate because project 0bc9de2c716a4bea96785a39af9fbeec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:12:43.618653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:43.619449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-1de90873-b2fe-4470-a571-217a661369aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:43.621267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 979/1967] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:12:43 2022] DELETE /identity/v3/projects/0bc9de2c716a4bea96785a39af9fbeec => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:43.630392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281df19-8787-417e-b4a4-18dd1b2c690d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:43.630882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281df19-8787-417e-b4a4-18dd1b2c690d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:43.630988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281df19-8787-417e-b4a4-18dd1b2c690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:43.637429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:43.653325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2281df19-8787-417e-b4a4-18dd1b2c690d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:43.656617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2281df19-8787-417e-b4a4-18dd1b2c690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:43.763118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 989/1968] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:43.771807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a941f-e3e1-464c-a7bf-350e3049b553 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:43.772094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a941f-e3e1-464c-a7bf-350e3049b553 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:43.772370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a941f-e3e1-464c-a7bf-350e3049b553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:43.792821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1a1a941f-e3e1-464c-a7bf-350e3049b553 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:43.794169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1a1a941f-e3e1-464c-a7bf-350e3049b553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:43.802763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 980/1969] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:43.807077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281df19-8787-417e-b4a4-18dd1b2c690d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:43.817051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281df19-8787-417e-b4a4-18dd1b2c690d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:43.821545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:43.822232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:43.822511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:43.822777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:43.823499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:12:43.823799 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:43.825383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:43.838653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 990/1970] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:12:43.842837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a941f-e3e1-464c-a7bf-350e3049b553 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:43.852341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a941f-e3e1-464c-a7bf-350e3049b553 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:43.856983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017dc5d-d424-4420-80ea-ac4ef662aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:43.857644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017dc5d-d424-4420-80ea-ac4ef662aa39 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:43.857968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017dc5d-d424-4420-80ea-ac4ef662aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:43.858246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017dc5d-d424-4420-80ea-ac4ef662aa39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:43.858957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017dc5d-d424-4420-80ea-ac4ef662aa39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:43.860935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017dc5d-d424-4420-80ea-ac4ef662aa39 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:43.889834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 981/1971] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:12:43 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:12:43.894156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:43.910194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fee8db-d1ea-4820-a590-dd05b53fe3d1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:43.968447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5db24-1c46-47ee-a4f6-dd39b2826286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:43.969131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5db24-1c46-47ee-a4f6-dd39b2826286 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:43.969411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5db24-1c46-47ee-a4f6-dd39b2826286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:43.969650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5db24-1c46-47ee-a4f6-dd39b2826286 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:43.970422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5db24-1c46-47ee-a4f6-dd39b2826286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:43.972372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5db24-1c46-47ee-a4f6-dd39b2826286 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:43.995334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 991/1972] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:12:43 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:12:43.999905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017dc5d-d424-4420-80ea-ac4ef662aa39 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:44.011295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017dc5d-d424-4420-80ea-ac4ef662aa39 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:44.016694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd2441-2b98-44bd-9860-5a998ed62991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:44.017446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2441-2b98-44bd-9860-5a998ed62991 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:44.017778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2441-2b98-44bd-9860-5a998ed62991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:44.018089 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2441-2b98-44bd-9860-5a998ed62991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:44.018818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd2441-2b98-44bd-9860-5a998ed62991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:44.020409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd2441-2b98-44bd-9860-5a998ed62991 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:44.031043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 982/1973] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:12:44.035342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5db24-1c46-47ee-a4f6-dd39b2826286 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:44.045578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5db24-1c46-47ee-a4f6-dd39b2826286 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:44.050663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888379f5-a689-433b-ac20-d20f4fb2e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:44.051323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888379f5-a689-433b-ac20-d20f4fb2e3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:44.051608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888379f5-a689-433b-ac20-d20f4fb2e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:44.051886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888379f5-a689-433b-ac20-d20f4fb2e3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:44.052621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888379f5-a689-433b-ac20-d20f4fb2e3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:44.054259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888379f5-a689-433b-ac20-d20f4fb2e3d5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:44.064667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 992/1974] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:12:44.068741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd2441-2b98-44bd-9860-5a998ed62991 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:44.078906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd2441-2b98-44bd-9860-5a998ed62991 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:44.083745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:44.084622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:44.084901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:44.085153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] PATH_INFO: `/v3/projects/f23f3a7c45554960990f7d12e9ca3703/users/015ae7591d4b47899c515d5b2e0d6604/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:44.100596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23f3a7c45554960990f7d12e9ca3703, user_id=015ae7591d4b47899c515d5b2e0d6604, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:44.103308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:44.118619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 983/1975] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:12:44 2022] PUT /identity/v3/projects/f23f3a7c45554960990f7d12e9ca3703/users/015ae7591d4b47899c515d5b2e0d6604/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:44.129150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fce13-bfd1-4b44-9968-f78267c60b8d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:44.129558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fce13-bfd1-4b44-9968-f78267c60b8d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:44.129929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fce13-bfd1-4b44-9968-f78267c60b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:44.157757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cc9fce13-bfd1-4b44-9968-f78267c60b8d None None] MFA Rules not processed for user `015ae7591d4b47899c515d5b2e0d6604`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:44.159173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cc9fce13-bfd1-4b44-9968-f78267c60b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:44.221459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:44.227850 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 993/1976] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:44.239158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:44.240723 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:44.301841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e61ff-2bc3-4899-a008-7231b8f50a36 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:44.305392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31e376-b22e-4231-919d-fad6729570c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:44.306082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31e376-b22e-4231-919d-fad6729570c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:44.306383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31e376-b22e-4231-919d-fad6729570c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:44.306638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31e376-b22e-4231-919d-fad6729570c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:44.315343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31e376-b22e-4231-919d-fad6729570c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:44.316787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31e376-b22e-4231-919d-fad6729570c1 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:44.325863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 984/1977] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:47.460946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fce13-bfd1-4b44-9968-f78267c60b8d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:47.462646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cc9fce13-bfd1-4b44-9968-f78267c60b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:47.476904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fce13-bfd1-4b44-9968-f78267c60b8d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:47.482791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47948673-4de6-409a-a7bb-bc0d3c0c8ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:47.483472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47948673-4de6-409a-a7bb-bc0d3c0c8ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:47.483764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47948673-4de6-409a-a7bb-bc0d3c0c8ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:47.484044 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47948673-4de6-409a-a7bb-bc0d3c0c8ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:47.487545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-47948673-4de6-409a-a7bb-bc0d3c0c8ef3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:47.564889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47948673-4de6-409a-a7bb-bc0d3c0c8ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:47.566775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47948673-4de6-409a-a7bb-bc0d3c0c8ef3 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:47.577978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 994/1978] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:54.321728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:57.571687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=29 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:58.021466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d380b8-15a7-49bf-bfa2-51684224ee1c None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:58.021993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d380b8-15a7-49bf-bfa2-51684224ee1c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:58.022101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d380b8-15a7-49bf-bfa2-51684224ee1c None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:58.023691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 985/1979] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:12:58.039660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2442ed-ba07-4f72-abd1-cb25d2a786ad None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:58.040064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2442ed-ba07-4f72-abd1-cb25d2a786ad None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:58.040541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2442ed-ba07-4f72-abd1-cb25d2a786ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:58.060925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4a2442ed-ba07-4f72-abd1-cb25d2a786ad None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:58.062308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4a2442ed-ba07-4f72-abd1-cb25d2a786ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:58.174458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 995/1980] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:12:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:12:58.200749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d380b8-15a7-49bf-bfa2-51684224ee1c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:58.202907 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-38d380b8-15a7-49bf-bfa2-51684224ee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:58.240957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d380b8-15a7-49bf-bfa2-51684224ee1c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:58.247065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661289-83f1-474b-8db0-55886e6088c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:58.248353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661289-83f1-474b-8db0-55886e6088c6 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:58.248848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661289-83f1-474b-8db0-55886e6088c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:58.250131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661289-83f1-474b-8db0-55886e6088c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:58.265220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84661289-83f1-474b-8db0-55886e6088c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:58.267370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84661289-83f1-474b-8db0-55886e6088c6 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:58.281812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 986/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:12:58.842597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2442ed-ba07-4f72-abd1-cb25d2a786ad None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:58.845066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4a2442ed-ba07-4f72-abd1-cb25d2a786ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:58.953612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2442ed-ba07-4f72-abd1-cb25d2a786ad None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:58.958652 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:58.962144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:58.963943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:58.964958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] PATH_INFO: `/v3/users/8985211d0de74cb5bfb998cdfbe9e77c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:58.966976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8985211d0de74cb5bfb998cdfbe9e77c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:58.970857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:59.063166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8985211d0de74cb5bfb998cdfbe9e77c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:59.064273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8985211d0de74cb5bfb998cdfbe9e77c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:59.077699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8985211d0de74cb5bfb998cdfbe9e77c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:59.094192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8985211d0de74cb5bfb998cdfbe9e77c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:59.108461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8985211d0de74cb5bfb998cdfbe9e77c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:12:59.118940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 996/1982] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:12:58 2022] DELETE /identity/v3/users/8985211d0de74cb5bfb998cdfbe9e77c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:12:59.124769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4762d-73e1-496b-8cdf-58e047e4039a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:59.125772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4762d-73e1-496b-8cdf-58e047e4039a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:59.126250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4762d-73e1-496b-8cdf-58e047e4039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:59.163499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-70d4762d-73e1-496b-8cdf-58e047e4039a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:12:59.165648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-70d4762d-73e1-496b-8cdf-58e047e4039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:59.275746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 987/1983] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:12:59.286566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:12:59.288411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:12:59.323935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:12:59.402174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335448fd-4698-412c-9ae6-f2403371564e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:12:59.407486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239022e3-f814-4507-bea4-244a3c4f1e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:12:59.408145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239022e3-f814-4507-bea4-244a3c4f1e64 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:12:59.408594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239022e3-f814-4507-bea4-244a3c4f1e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:12:59.408842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239022e3-f814-4507-bea4-244a3c4f1e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:12:59.421672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239022e3-f814-4507-bea4-244a3c4f1e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:12:59.423368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239022e3-f814-4507-bea4-244a3c4f1e64 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:12:59.435648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 997/1984] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:00.210917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4762d-73e1-496b-8cdf-58e047e4039a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:00.212746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-70d4762d-73e1-496b-8cdf-58e047e4039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:00.229756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4762d-73e1-496b-8cdf-58e047e4039a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:00.235206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:00.236081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:00.236354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:00.236802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] PATH_INFO: `/v3/projects/ce7459c1f6314a32a20974ed2bb93741` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:00.238624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7459c1f6314a32a20974ed2bb93741)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:00.241211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:00.297256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7459c1f6314a32a20974ed2bb93741', 'request_id': 'req-0aa08424-4886-48c8-83f7-7e8262c727ff'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.303153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7459c1f6314a32a20974ed2bb93741', 'request_id': 'req-0aa08424-4886-48c8-83f7-7e8262c727ff'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.309641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7459c1f6314a32a20974ed2bb93741', 'request_id': 'req-0aa08424-4886-48c8-83f7-7e8262c727ff'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.330798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] The token cache is being invalidate because project ce7459c1f6314a32a20974ed2bb93741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:00.331187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.331946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.336614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 988/1985] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:00 2022] DELETE /identity/v3/projects/ce7459c1f6314a32a20974ed2bb93741 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:00.337971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239022e3-f814-4507-bea4-244a3c4f1e64 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:00.350358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239022e3-f814-4507-bea4-244a3c4f1e64 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:00.465013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:00.466137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:00.466485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:00.466917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] PATH_INFO: `/v3/users/66cac324f619468ba98c121b73566f39` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:00.468769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=66cac324f619468ba98c121b73566f39)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:00.472252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:00.542330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66cac324f619468ba98c121b73566f39'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.543458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66cac324f619468ba98c121b73566f39'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.552699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66cac324f619468ba98c121b73566f39'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.561655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66cac324f619468ba98c121b73566f39'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.582113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66cac324f619468ba98c121b73566f39'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:00.590303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 998/1986] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:00 2022] DELETE /identity/v3/users/66cac324f619468ba98c121b73566f39 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:00.907567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:00.909492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:00.925684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa08424-4886-48c8-83f7-7e8262c727ff admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:00.985565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:00.986488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:00.986767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:00.987042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] PATH_INFO: `/v3/projects/b3248112ec8d45c39059247f579cd018` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:00.988250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3248112ec8d45c39059247f579cd018)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:00.990221 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:01.003392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:01.049849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3248112ec8d45c39059247f579cd018', 'request_id': 'req-20374821-4823-4a34-a9e4-13468b4282a0'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.056171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3248112ec8d45c39059247f579cd018', 'request_id': 'req-20374821-4823-4a34-a9e4-13468b4282a0'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.065492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3248112ec8d45c39059247f579cd018', 'request_id': 'req-20374821-4823-4a34-a9e4-13468b4282a0'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.081043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] The token cache is being invalidate because project b3248112ec8d45c39059247f579cd018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:01.081317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.082184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.083815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 989/1987] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:00 2022] DELETE /identity/v3/projects/b3248112ec8d45c39059247f579cd018 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:01.088033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:01.089725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:01.103642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce66d4-c227-4dde-b64f-689d31dcdeaf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:01.137094 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:01.166878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:01.167762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.168040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.168311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] PATH_INFO: `/v3/users/65830a208e51493d9bd398dc89277368` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.169518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65830a208e51493d9bd398dc89277368)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:01.171551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:01.220937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65830a208e51493d9bd398dc89277368'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.221593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65830a208e51493d9bd398dc89277368'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.230502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65830a208e51493d9bd398dc89277368'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.238146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65830a208e51493d9bd398dc89277368'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.251615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65830a208e51493d9bd398dc89277368'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.258944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 999/1988] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:01 2022] DELETE /identity/v3/users/65830a208e51493d9bd398dc89277368 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:01.405640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:01.407352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:01.434404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20374821-4823-4a34-a9e4-13468b4282a0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:01.513546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:01.514475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.515052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.515347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] PATH_INFO: `/v3/users/015ae7591d4b47899c515d5b2e0d6604` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.516599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] RBAC: Authorizing `identity:delete_user(user_id=015ae7591d4b47899c515d5b2e0d6604)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:01.518956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:01.558151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:01.559781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:01.576928 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d78cd-d410-46dc-8f7b-6c2a1ebb2ff9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:01.584781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015ae7591d4b47899c515d5b2e0d6604'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.586497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:01.587549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.587874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.588289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] PATH_INFO: `/v3/projects/94f8be37e854470c8de91d23a0a9fe98` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.589737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f8be37e854470c8de91d23a0a9fe98)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:01.592363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:01.595793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015ae7591d4b47899c515d5b2e0d6604'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.608751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015ae7591d4b47899c515d5b2e0d6604'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.616753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015ae7591d4b47899c515d5b2e0d6604'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.617488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-23fe111d-ba26-405d-9e00-862517bd555e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015ae7591d4b47899c515d5b2e0d6604'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.626866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 990/1989] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:01 2022] DELETE /identity/v3/users/015ae7591d4b47899c515d5b2e0d6604 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:01.631169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd51ed-12d3-440a-b4a1-275adcfdcea1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.631538 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd51ed-12d3-440a-b4a1-275adcfdcea1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.631841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd51ed-12d3-440a-b4a1-275adcfdcea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.649695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f8be37e854470c8de91d23a0a9fe98', 'request_id': 'req-2fe6508a-2a90-4f42-9899-1e2dd391999f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.658770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f8be37e854470c8de91d23a0a9fe98', 'request_id': 'req-2fe6508a-2a90-4f42-9899-1e2dd391999f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.659522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f3cd51ed-12d3-440a-b4a1-275adcfdcea1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:01.660813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f3cd51ed-12d3-440a-b4a1-275adcfdcea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:01.668547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f8be37e854470c8de91d23a0a9fe98', 'request_id': 'req-2fe6508a-2a90-4f42-9899-1e2dd391999f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.683709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:01.684866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] The token cache is being invalidate because project 94f8be37e854470c8de91d23a0a9fe98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:01.685086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.686231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2fe6508a-2a90-4f42-9899-1e2dd391999f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:01.688116 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1000/1990] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:01 2022] DELETE /identity/v3/projects/94f8be37e854470c8de91d23a0a9fe98 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:01.694622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ec0e-a21f-4632-9851-e3b7bfca09a9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.694948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ec0e-a21f-4632-9851-e3b7bfca09a9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.695400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ec0e-a21f-4632-9851-e3b7bfca09a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.719239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-39c1ec0e-a21f-4632-9851-e3b7bfca09a9 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:01.720945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-39c1ec0e-a21f-4632-9851-e3b7bfca09a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:01.744129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 991/1991] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:01.754047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd51ed-12d3-440a-b4a1-275adcfdcea1 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:01.755435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f3cd51ed-12d3-440a-b4a1-275adcfdcea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:01.764085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:01.804065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1001/1992] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:01.812820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3dccc-59c9-4880-ad1c-ae0a87953486 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.813115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3dccc-59c9-4880-ad1c-ae0a87953486 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.813772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3dccc-59c9-4880-ad1c-ae0a87953486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.819432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd51ed-12d3-440a-b4a1-275adcfdcea1 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:01.823532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336147c9-669c-4750-9803-6f512c116168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:01.824216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336147c9-669c-4750-9803-6f512c116168 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.824497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336147c9-669c-4750-9803-6f512c116168 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.824794 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336147c9-669c-4750-9803-6f512c116168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.832600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aee3dccc-59c9-4880-ad1c-ae0a87953486 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:01.833828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aee3dccc-59c9-4880-ad1c-ae0a87953486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:01.834093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336147c9-669c-4750-9803-6f512c116168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:01.835605 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336147c9-669c-4750-9803-6f512c116168 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:01.841821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1002/1993] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:01.845689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 992/1994] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:01.846112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3dccc-59c9-4880-ad1c-ae0a87953486 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:01.855343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3dccc-59c9-4880-ad1c-ae0a87953486 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:01.860001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:01.860665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.860944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.861218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.861984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:01.862393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:01.864127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:01.875923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1003/1995] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:13:01.880547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336147c9-669c-4750-9803-6f512c116168 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:01.890883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336147c9-669c-4750-9803-6f512c116168 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:01.896631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e01338-1ba6-4fe2-8ff8-3c49763e968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:01.897410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e01338-1ba6-4fe2-8ff8-3c49763e968a admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:01.897689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e01338-1ba6-4fe2-8ff8-3c49763e968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:01.898023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e01338-1ba6-4fe2-8ff8-3c49763e968a admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:01.898706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e01338-1ba6-4fe2-8ff8-3c49763e968a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:01.900919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e01338-1ba6-4fe2-8ff8-3c49763e968a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:01.929197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 993/1996] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:01 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:01.932888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:01.944433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d7803-31d4-4a97-9a83-b2cca8b60ed8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.027589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269ccd-2747-48a3-9dbf-5d4c7047efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.028695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269ccd-2747-48a3-9dbf-5d4c7047efac admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.029200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269ccd-2747-48a3-9dbf-5d4c7047efac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.029684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269ccd-2747-48a3-9dbf-5d4c7047efac admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.030768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269ccd-2747-48a3-9dbf-5d4c7047efac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.033079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269ccd-2747-48a3-9dbf-5d4c7047efac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.071259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1004/1997] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:01 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:02.073355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e01338-1ba6-4fe2-8ff8-3c49763e968a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.091582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e01338-1ba6-4fe2-8ff8-3c49763e968a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.098598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fdc07-7805-447f-9e9f-045d53670600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.106111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fdc07-7805-447f-9e9f-045d53670600 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.106408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fdc07-7805-447f-9e9f-045d53670600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.106692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fdc07-7805-447f-9e9f-045d53670600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.107458 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fdc07-7805-447f-9e9f-045d53670600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.109088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fdc07-7805-447f-9e9f-045d53670600 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.122369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 994/1998] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:02.126174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269ccd-2747-48a3-9dbf-5d4c7047efac admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.138234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269ccd-2747-48a3-9dbf-5d4c7047efac admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.142952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.143715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.143999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.144455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.145194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.146986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.162033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1005/1999] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:02.163613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fdc07-7805-447f-9e9f-045d53670600 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.179750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fdc07-7805-447f-9e9f-045d53670600 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.184957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3289f8-9b35-49c7-af39-f6da288a5296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.186898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.187631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3289f8-9b35-49c7-af39-f6da288a5296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.187918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3289f8-9b35-49c7-af39-f6da288a5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.188202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3289f8-9b35-49c7-af39-f6da288a5296 admin admin] PATH_INFO: `/v3/projects/f59a62d2213b4619b243e1bf28846b13/users/11e0369ddad94d6e850c9ddf8c8573f1/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.190658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:02.212721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3289f8-9b35-49c7-af39-f6da288a5296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59a62d2213b4619b243e1bf28846b13, user_id=11e0369ddad94d6e850c9ddf8c8573f1, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.217639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3289f8-9b35-49c7-af39-f6da288a5296 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.218323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2c57f-208a-4aa6-86d1-a66fb8d6278a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.225735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.226718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.227006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.227281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] PATH_INFO: `/v3/projects/f23f3a7c45554960990f7d12e9ca3703` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.229360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23f3a7c45554960990f7d12e9ca3703)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.231650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.241848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 995/2000] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:02 2022] PUT /identity/v3/projects/f59a62d2213b4619b243e1bf28846b13/users/11e0369ddad94d6e850c9ddf8c8573f1/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:02.249258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124d3b-0ebe-4c7d-8574-7e27548d24ee None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.249718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124d3b-0ebe-4c7d-8574-7e27548d24ee None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.250189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124d3b-0ebe-4c7d-8574-7e27548d24ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.282058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-48124d3b-0ebe-4c7d-8574-7e27548d24ee None None] MFA Rules not processed for user `11e0369ddad94d6e850c9ddf8c8573f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:02.283240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-48124d3b-0ebe-4c7d-8574-7e27548d24ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:02.292805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23f3a7c45554960990f7d12e9ca3703', 'request_id': 'req-99d9ee51-e50b-40b2-a0f4-779425f6cf30'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:02.298395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23f3a7c45554960990f7d12e9ca3703', 'request_id': 'req-99d9ee51-e50b-40b2-a0f4-779425f6cf30'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:02.305253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23f3a7c45554960990f7d12e9ca3703', 'request_id': 'req-99d9ee51-e50b-40b2-a0f4-779425f6cf30'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:02.324518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] The token cache is being invalidate because project f23f3a7c45554960990f7d12e9ca3703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:02.324800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:02.325575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-99d9ee51-e50b-40b2-a0f4-779425f6cf30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:02.327211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1006/2001] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:02 2022] DELETE /identity/v3/projects/f23f3a7c45554960990f7d12e9ca3703 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:02.336676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff67a-95fb-4b80-9f43-f7f228625e55 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.336808 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff67a-95fb-4b80-9f43-f7f228625e55 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.337085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff67a-95fb-4b80-9f43-f7f228625e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.345067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:02.355919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5e2ff67a-95fb-4b80-9f43-f7f228625e55 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:02.357142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5e2ff67a-95fb-4b80-9f43-f7f228625e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:02.359987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 996/2002] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:02.364828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124d3b-0ebe-4c7d-8574-7e27548d24ee None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.366261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-48124d3b-0ebe-4c7d-8574-7e27548d24ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:02.371527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:02.427837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1007/2003] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:02.435478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533e20-16cc-414e-9d4e-95facf0b5168 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.435773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533e20-16cc-414e-9d4e-95facf0b5168 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.436393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533e20-16cc-414e-9d4e-95facf0b5168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.439856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124d3b-0ebe-4c7d-8574-7e27548d24ee None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.444787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653a9cc-c3b8-4863-b61e-49cc9d93cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.445474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a9cc-c3b8-4863-b61e-49cc9d93cee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.445804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a9cc-c3b8-4863-b61e-49cc9d93cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.446083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a9cc-c3b8-4863-b61e-49cc9d93cee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.446791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653a9cc-c3b8-4863-b61e-49cc9d93cee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.448727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653a9cc-c3b8-4863-b61e-49cc9d93cee3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.455946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-05533e20-16cc-414e-9d4e-95facf0b5168 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:02.457259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-05533e20-16cc-414e-9d4e-95facf0b5168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:02.465352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1008/2004] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:02.469997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05533e20-16cc-414e-9d4e-95facf0b5168 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.479329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05533e20-16cc-414e-9d4e-95facf0b5168 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.484294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 997/2005] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:02 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:02.485864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653a9cc-c3b8-4863-b61e-49cc9d93cee3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.539632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.540405 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.540775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.541131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.541982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:02.542364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.544048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.559029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1009/2006] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:13:02.560016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.562612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653a9cc-c3b8-4863-b61e-49cc9d93cee3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.568361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084645e-08aa-41aa-81c2-4c8b61f5f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.568730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084645e-08aa-41aa-81c2-4c8b61f5f964 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.569017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084645e-08aa-41aa-81c2-4c8b61f5f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.569299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084645e-08aa-41aa-81c2-4c8b61f5f964 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.570438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084645e-08aa-41aa-81c2-4c8b61f5f964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.572371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084645e-08aa-41aa-81c2-4c8b61f5f964 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.572829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f67c9-13f3-4291-b3f2-8ae9ccd0ece5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.578040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27669685-831b-4c59-8ac6-f4aa68b46522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.578891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27669685-831b-4c59-8ac6-f4aa68b46522 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.579366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27669685-831b-4c59-8ac6-f4aa68b46522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.579789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27669685-831b-4c59-8ac6-f4aa68b46522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.580698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27669685-831b-4c59-8ac6-f4aa68b46522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.583090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27669685-831b-4c59-8ac6-f4aa68b46522 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.600483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 998/2007] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:02 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:02.601479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084645e-08aa-41aa-81c2-4c8b61f5f964 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.613347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084645e-08aa-41aa-81c2-4c8b61f5f964 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.617744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1010/2008] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:02 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:02.617904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77bd2c-58bc-4884-8d59-737394b0c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.618564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bd2c-58bc-4884-8d59-737394b0c0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.618846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bd2c-58bc-4884-8d59-737394b0c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.619096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bd2c-58bc-4884-8d59-737394b0c0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.619952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77bd2c-58bc-4884-8d59-737394b0c0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.621635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77bd2c-58bc-4884-8d59-737394b0c0c1 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.622109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27669685-831b-4c59-8ac6-f4aa68b46522 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.633542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 999/2009] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:02.637603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77bd2c-58bc-4884-8d59-737394b0c0c1 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.649243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77bd2c-58bc-4884-8d59-737394b0c0c1 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.697493 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27669685-831b-4c59-8ac6-f4aa68b46522 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.703125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016816a-ae7d-4f35-b4cc-4f84388a7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.703888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016816a-ae7d-4f35-b4cc-4f84388a7412 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.704263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016816a-ae7d-4f35-b4cc-4f84388a7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.704554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016816a-ae7d-4f35-b4cc-4f84388a7412 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.705262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016816a-ae7d-4f35-b4cc-4f84388a7412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.708364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016816a-ae7d-4f35-b4cc-4f84388a7412 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.724024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb1ae2-a9dd-424e-8b81-d7482046452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.724956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb1ae2-a9dd-424e-8b81-d7482046452f admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.725289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb1ae2-a9dd-424e-8b81-d7482046452f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.725483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb1ae2-a9dd-424e-8b81-d7482046452f admin admin] PATH_INFO: `/v3/projects/e4f3bbf795364c31a499c5e1588174c0/users/44eddb1e358447b0ab253162e3ff31a9/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.727896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:02.748562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1011/2010] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:02 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:02.749591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016816a-ae7d-4f35-b4cc-4f84388a7412 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.752751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb1ae2-a9dd-424e-8b81-d7482046452f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f3bbf795364c31a499c5e1588174c0, user_id=44eddb1e358447b0ab253162e3ff31a9, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.755885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb1ae2-a9dd-424e-8b81-d7482046452f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.760527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016816a-ae7d-4f35-b4cc-4f84388a7412 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.765740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb33ec7-7346-4765-aedd-5d384658cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.766414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb33ec7-7346-4765-aedd-5d384658cb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.766685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb33ec7-7346-4765-aedd-5d384658cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.767061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb33ec7-7346-4765-aedd-5d384658cb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.767685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb33ec7-7346-4765-aedd-5d384658cb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.769481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb33ec7-7346-4765-aedd-5d384658cb9d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.773025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1000/2011] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:02 2022] PUT /identity/v3/projects/e4f3bbf795364c31a499c5e1588174c0/users/44eddb1e358447b0ab253162e3ff31a9/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:02.776610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb1ae2-a9dd-424e-8b81-d7482046452f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.781836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1012/2012] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:02.784478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb33ec7-7346-4765-aedd-5d384658cb9d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.792444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:02.798386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb33ec7-7346-4765-aedd-5d384658cb9d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.869080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb1ae2-a9dd-424e-8b81-d7482046452f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.878630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25389e-23cc-4e38-8ae9-a0578835d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.879436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25389e-23cc-4e38-8ae9-a0578835d839 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.879725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25389e-23cc-4e38-8ae9-a0578835d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.879995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25389e-23cc-4e38-8ae9-a0578835d839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.880742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25389e-23cc-4e38-8ae9-a0578835d839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.882401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25389e-23cc-4e38-8ae9-a0578835d839 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.894900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1001/2013] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:02.898707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daae7b-7846-411f-9829-4c6d1fee7515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.899495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daae7b-7846-411f-9829-4c6d1fee7515 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.899991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daae7b-7846-411f-9829-4c6d1fee7515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.900336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daae7b-7846-411f-9829-4c6d1fee7515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.901192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daae7b-7846-411f-9829-4c6d1fee7515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.901303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25389e-23cc-4e38-8ae9-a0578835d839 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.903365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daae7b-7846-411f-9829-4c6d1fee7515 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.912564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25389e-23cc-4e38-8ae9-a0578835d839 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.917665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1013/2014] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:02.919009 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43667e2-70b3-438c-af76-16e7aea8c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:02.920014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43667e2-70b3-438c-af76-16e7aea8c729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.920355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43667e2-70b3-438c-af76-16e7aea8c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.921015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43667e2-70b3-438c-af76-16e7aea8c729 admin admin] PATH_INFO: `/v3/projects/e4f3bbf795364c31a499c5e1588174c0/users/44eddb1e358447b0ab253162e3ff31a9/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.922107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daae7b-7846-411f-9829-4c6d1fee7515 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:02.927920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43667e2-70b3-438c-af76-16e7aea8c729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f3bbf795364c31a499c5e1588174c0, user_id=44eddb1e358447b0ab253162e3ff31a9, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:02.931026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43667e2-70b3-438c-af76-16e7aea8c729 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:02.936312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daae7b-7846-411f-9829-4c6d1fee7515 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:02.944757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1002/2015] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:02 2022] PUT /identity/v3/projects/e4f3bbf795364c31a499c5e1588174c0/users/44eddb1e358447b0ab253162e3ff31a9/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:02.954902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae6cc4-77bf-4215-864b-d00d63fc51c3 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:02.955194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae6cc4-77bf-4215-864b-d00d63fc51c3 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:02.955477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae6cc4-77bf-4215-864b-d00d63fc51c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:02.987950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-cfae6cc4-77bf-4215-864b-d00d63fc51c3 None None] MFA Rules not processed for user `44eddb1e358447b0ab253162e3ff31a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:02.990031 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-cfae6cc4-77bf-4215-864b-d00d63fc51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:03.022804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ffed2-f047-4324-9840-0052e5740a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:03.023966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ffed2-f047-4324-9840-0052e5740a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:03.024330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ffed2-f047-4324-9840-0052e5740a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:03.024514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ffed2-f047-4324-9840-0052e5740a92 admin admin] PATH_INFO: `/v3/projects/f21a4ef5cd5d43a1bb3013bd441b41b0/users/33bbbac0dcd84e5e9c50d47978fe9292/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:03.041880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ffed2-f047-4324-9840-0052e5740a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21a4ef5cd5d43a1bb3013bd441b41b0, user_id=33bbbac0dcd84e5e9c50d47978fe9292, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:03.044685 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ffed2-f047-4324-9840-0052e5740a92 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:03.061274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1014/2016] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:02 2022] PUT /identity/v3/projects/f21a4ef5cd5d43a1bb3013bd441b41b0/users/33bbbac0dcd84e5e9c50d47978fe9292/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:03.073299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2ba4-661a-4742-8362-cd2e20ca827f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:03.073601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2ba4-661a-4742-8362-cd2e20ca827f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:03.073919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2ba4-661a-4742-8362-cd2e20ca827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:03.089834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1003/2017] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:03.102805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e10b2ba4-661a-4742-8362-cd2e20ca827f None None] MFA Rules not processed for user `33bbbac0dcd84e5e9c50d47978fe9292`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:03.103947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e10b2ba4-661a-4742-8362-cd2e20ca827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:03.104640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae6cc4-77bf-4215-864b-d00d63fc51c3 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:03.106226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-cfae6cc4-77bf-4215-864b-d00d63fc51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:03.164096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae6cc4-77bf-4215-864b-d00d63fc51c3 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:03.167692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:03.176023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1015/2018] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:03.188964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2ba4-661a-4742-8362-cd2e20ca827f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:03.198396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e10b2ba4-661a-4742-8362-cd2e20ca827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:03.213307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:03.221214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e5221-01ca-47a5-9590-3d954c8046d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:03.222165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5221-01ca-47a5-9590-3d954c8046d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:03.222358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5221-01ca-47a5-9590-3d954c8046d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:03.222631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5221-01ca-47a5-9590-3d954c8046d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:03.266078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2ba4-661a-4742-8362-cd2e20ca827f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:03.271093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a7b5d-f612-469b-9200-f6e340064acc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c211cd37d7f49eaa916d332580135c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:03.272219 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7b5d-f612-469b-9200-f6e340064acc service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:03.272739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7b5d-f612-469b-9200-f6e340064acc service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:03.273059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7b5d-f612-469b-9200-f6e340064acc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:03.282430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a7b5d-f612-469b-9200-f6e340064acc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:03.284456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a7b5d-f612-469b-9200-f6e340064acc service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:03.291172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e5221-01ca-47a5-9590-3d954c8046d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:03.291375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e5221-01ca-47a5-9590-3d954c8046d6 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:03.299796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1016/2019] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:03.306644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1004/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:03.444918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a7b5d-f612-469b-9200-f6e340064acc service glance] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:03.509722 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a7b5d-f612-469b-9200-f6e340064acc service glance] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:03.514382 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:03.515266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:03.515549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:03.516154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] PATH_INFO: `/v3/users/11e0369ddad94d6e850c9ddf8c8573f1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:03.517609 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e0369ddad94d6e850c9ddf8c8573f1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:03.520156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:03.579210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e0369ddad94d6e850c9ddf8c8573f1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:03.579880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e0369ddad94d6e850c9ddf8c8573f1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:03.591466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e0369ddad94d6e850c9ddf8c8573f1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:03.602289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e0369ddad94d6e850c9ddf8c8573f1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:03.621304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e0369ddad94d6e850c9ddf8c8573f1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:03.636019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1017/2021] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:03 2022] DELETE /identity/v3/users/11e0369ddad94d6e850c9ddf8c8573f1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:03.642871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0e58-94ad-4011-bd46-cfd7537748e4 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:03.643487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0e58-94ad-4011-bd46-cfd7537748e4 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:03.643651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0e58-94ad-4011-bd46-cfd7537748e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:03.682639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a6ab0e58-94ad-4011-bd46-cfd7537748e4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:03.684416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a6ab0e58-94ad-4011-bd46-cfd7537748e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:03.777361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1005/2022] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:03.790441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:03.792101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:03.844067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:03.872815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eec14b-be74-460b-b769-c46bbd65b0a5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:03.877385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9198faa-c7cd-4392-aadf-33be6e3c6d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:03.878284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198faa-c7cd-4392-aadf-33be6e3c6d0e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:03.878612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198faa-c7cd-4392-aadf-33be6e3c6d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:03.878991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9198faa-c7cd-4392-aadf-33be6e3c6d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:03.891734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9198faa-c7cd-4392-aadf-33be6e3c6d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:03.893367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9198faa-c7cd-4392-aadf-33be6e3c6d0e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:03.905032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1018/2023] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:04.204221 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0e58-94ad-4011-bd46-cfd7537748e4 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:04.207421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a6ab0e58-94ad-4011-bd46-cfd7537748e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:04.219777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0e58-94ad-4011-bd46-cfd7537748e4 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:04.224554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:04.225447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:04.225730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:04.226062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] PATH_INFO: `/v3/projects/f59a62d2213b4619b243e1bf28846b13` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:04.227264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59a62d2213b4619b243e1bf28846b13)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:04.229196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:04.275979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59a62d2213b4619b243e1bf28846b13', 'request_id': 'req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.278071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:04.282404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59a62d2213b4619b243e1bf28846b13', 'request_id': 'req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.289330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59a62d2213b4619b243e1bf28846b13', 'request_id': 'req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.306100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] The token cache is being invalidate because project f59a62d2213b4619b243e1bf28846b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:04.306389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.307053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.308641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1006/2024] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:04 2022] DELETE /identity/v3/projects/f59a62d2213b4619b243e1bf28846b13 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:04.312679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9198faa-c7cd-4392-aadf-33be6e3c6d0e service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:04.323522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9198faa-c7cd-4392-aadf-33be6e3c6d0e service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:04.387623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:04.388453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:04.388726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:04.388994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] PATH_INFO: `/v3/users/44eddb1e358447b0ab253162e3ff31a9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:04.390263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44eddb1e358447b0ab253162e3ff31a9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:04.392812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:04.446631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44eddb1e358447b0ab253162e3ff31a9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.447560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44eddb1e358447b0ab253162e3ff31a9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.459150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44eddb1e358447b0ab253162e3ff31a9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.466525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44eddb1e358447b0ab253162e3ff31a9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.479444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2be08a79-9d69-43f9-8da4-8f5c42a055c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44eddb1e358447b0ab253162e3ff31a9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.485897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1019/2025] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:04 2022] DELETE /identity/v3/users/44eddb1e358447b0ab253162e3ff31a9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:04.764116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:04.766090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:04.792918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff5e43-1bc1-48aa-b453-dd11a0dd143b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:04.866112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:04.867042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:04.867284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:04.867564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] PATH_INFO: `/v3/projects/e4f3bbf795364c31a499c5e1588174c0` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:04.868772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f3bbf795364c31a499c5e1588174c0)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:04.870751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:04.922444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f3bbf795364c31a499c5e1588174c0', 'request_id': 'req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.928818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f3bbf795364c31a499c5e1588174c0', 'request_id': 'req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.937293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f3bbf795364c31a499c5e1588174c0', 'request_id': 'req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.951946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] The token cache is being invalidate because project e4f3bbf795364c31a499c5e1588174c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:04.952234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.952843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7944fb35-cbf5-4b3b-9f5a-7dd3e461ee88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:04.954517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1007/2026] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:04 2022] DELETE /identity/v3/projects/e4f3bbf795364c31a499c5e1588174c0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:04.959906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3f86-2b0d-4a86-9dc5-6f2714a79de1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:04.960370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3f86-2b0d-4a86-9dc5-6f2714a79de1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:04.960461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e3f86-2b0d-4a86-9dc5-6f2714a79de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:04.977892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-509e3f86-2b0d-4a86-9dc5-6f2714a79de1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:04.979140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-509e3f86-2b0d-4a86-9dc5-6f2714a79de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:05.025988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:05.040264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1020/2027] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:05.049242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74551-2e05-4684-876e-d50a76dd0d80 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.049596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74551-2e05-4684-876e-d50a76dd0d80 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.049894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74551-2e05-4684-876e-d50a76dd0d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.068592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2da74551-2e05-4684-876e-d50a76dd0d80 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:05.069821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2da74551-2e05-4684-876e-d50a76dd0d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:05.078271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1008/2028] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:05.083238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e3f86-2b0d-4a86-9dc5-6f2714a79de1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.098711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e3f86-2b0d-4a86-9dc5-6f2714a79de1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.106535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.107453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.107802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.108101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.108826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:05.109128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.110748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.123659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1021/2029] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:13:05.128067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74551-2e05-4684-876e-d50a76dd0d80 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.137491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74551-2e05-4684-876e-d50a76dd0d80 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.142349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6474-cdb2-414e-9a22-bdead70a349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.143003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6474-cdb2-414e-9a22-bdead70a349d admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.143443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6474-cdb2-414e-9a22-bdead70a349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.143724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e6474-cdb2-414e-9a22-bdead70a349d admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.144449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e6474-cdb2-414e-9a22-bdead70a349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.146409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e6474-cdb2-414e-9a22-bdead70a349d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.174435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1009/2030] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:05 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:05.178898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.189105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028b060-5c5e-4df9-8ea5-e4728f8d552a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.270063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e64f1c-a982-4591-aecb-2cb3a016343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.270753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64f1c-a982-4591-aecb-2cb3a016343b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.271034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64f1c-a982-4591-aecb-2cb3a016343b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.271465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64f1c-a982-4591-aecb-2cb3a016343b admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.272171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e64f1c-a982-4591-aecb-2cb3a016343b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.274124 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e64f1c-a982-4591-aecb-2cb3a016343b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.301011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1022/2031] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:05 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:05.302296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6474-cdb2-414e-9a22-bdead70a349d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.313719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e6474-cdb2-414e-9a22-bdead70a349d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.318468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f54e-92f8-4a3f-b705-4570ab4e9e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.319145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f54e-92f8-4a3f-b705-4570ab4e9e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.319427 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f54e-92f8-4a3f-b705-4570ab4e9e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.319701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811f54e-92f8-4a3f-b705-4570ab4e9e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.320483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f54e-92f8-4a3f-b705-4570ab4e9e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.322126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811f54e-92f8-4a3f-b705-4570ab4e9e77 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.335978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1010/2032] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:05.340060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e64f1c-a982-4591-aecb-2cb3a016343b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.350665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e64f1c-a982-4591-aecb-2cb3a016343b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.356451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e4d83-b74b-4b2a-9417-4fe31032ddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.357240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e4d83-b74b-4b2a-9417-4fe31032ddf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.357647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e4d83-b74b-4b2a-9417-4fe31032ddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.358016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e4d83-b74b-4b2a-9417-4fe31032ddf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.358748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e4d83-b74b-4b2a-9417-4fe31032ddf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.360775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e4d83-b74b-4b2a-9417-4fe31032ddf6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.375096 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1023/2033] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:05.377926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f54e-92f8-4a3f-b705-4570ab4e9e77 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.391505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811f54e-92f8-4a3f-b705-4570ab4e9e77 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.396042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea81502-3944-47cb-a07f-8e420ab60f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.397112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea81502-3944-47cb-a07f-8e420ab60f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.397401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea81502-3944-47cb-a07f-8e420ab60f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.397684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea81502-3944-47cb-a07f-8e420ab60f3f admin admin] PATH_INFO: `/v3/projects/7c3ad7643fd54090a5b447fe618a47fb/users/52eb4f5106c9404d97965b092506ce08/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.415088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea81502-3944-47cb-a07f-8e420ab60f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3ad7643fd54090a5b447fe618a47fb, user_id=52eb4f5106c9404d97965b092506ce08, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.418046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea81502-3944-47cb-a07f-8e420ab60f3f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.432993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1011/2034] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:05 2022] PUT /identity/v3/projects/7c3ad7643fd54090a5b447fe618a47fb/users/52eb4f5106c9404d97965b092506ce08/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:05.443841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338e409-a499-494a-ba21-c6d4c245bc8b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.444465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338e409-a499-494a-ba21-c6d4c245bc8b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.444789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338e409-a499-494a-ba21-c6d4c245bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.477414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b338e409-a499-494a-ba21-c6d4c245bc8b None None] MFA Rules not processed for user `52eb4f5106c9404d97965b092506ce08`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:05.479901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b338e409-a499-494a-ba21-c6d4c245bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:05.561737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1024/2035] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:05.562953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea81502-3944-47cb-a07f-8e420ab60f3f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.574503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:05.665147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea81502-3944-47cb-a07f-8e420ab60f3f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.670308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa87c6-221f-4566-ada6-34c89ffd6375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.671121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa87c6-221f-4566-ada6-34c89ffd6375 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.671413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa87c6-221f-4566-ada6-34c89ffd6375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.671690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa87c6-221f-4566-ada6-34c89ffd6375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.672418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa87c6-221f-4566-ada6-34c89ffd6375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.674829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa87c6-221f-4566-ada6-34c89ffd6375 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.708841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1012/2036] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:05 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:05.712931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338e409-a499-494a-ba21-c6d4c245bc8b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.724841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338e409-a499-494a-ba21-c6d4c245bc8b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.774002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:05.784772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647993b3-1d9a-4b58-95b7-107a681ed95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.785456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647993b3-1d9a-4b58-95b7-107a681ed95f admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.785740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647993b3-1d9a-4b58-95b7-107a681ed95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.786052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647993b3-1d9a-4b58-95b7-107a681ed95f admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.786776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647993b3-1d9a-4b58-95b7-107a681ed95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.789416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647993b3-1d9a-4b58-95b7-107a681ed95f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.812632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1025/2037] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:05 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:05.816959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa87c6-221f-4566-ada6-34c89ffd6375 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.828877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa87c6-221f-4566-ada6-34c89ffd6375 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.834301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68842f9a-c0ce-487f-96cf-31993ed3154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.834994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842f9a-c0ce-487f-96cf-31993ed3154e admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.835276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842f9a-c0ce-487f-96cf-31993ed3154e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.835549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68842f9a-c0ce-487f-96cf-31993ed3154e admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.836285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68842f9a-c0ce-487f-96cf-31993ed3154e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.837970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68842f9a-c0ce-487f-96cf-31993ed3154e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.853840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1013/2038] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:05.858153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647993b3-1d9a-4b58-95b7-107a681ed95f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.869302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647993b3-1d9a-4b58-95b7-107a681ed95f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:05.877120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa4e71-bec3-432f-a741-7f37e260e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:05.878084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4e71-bec3-432f-a741-7f37e260e9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:05.878519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4e71-bec3-432f-a741-7f37e260e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:05.878805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4e71-bec3-432f-a741-7f37e260e9c8 admin admin] PATH_INFO: `/v3/projects/8d79c328d68b44c9aaaf525b528dcf5e/users/6c1bb5040d264f0daa84d40f6729fb30/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:05.895711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4e71-bec3-432f-a741-7f37e260e9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d79c328d68b44c9aaaf525b528dcf5e, user_id=6c1bb5040d264f0daa84d40f6729fb30, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:05.899119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4e71-bec3-432f-a741-7f37e260e9c8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:05.917592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1026/2039] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:05 2022] PUT /identity/v3/projects/8d79c328d68b44c9aaaf525b528dcf5e/users/6c1bb5040d264f0daa84d40f6729fb30/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:05.922377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68842f9a-c0ce-487f-96cf-31993ed3154e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:05.946178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68842f9a-c0ce-487f-96cf-31993ed3154e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:06.044485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3da846-d5e3-4589-8cdb-5114c48cd46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:06.045779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3da846-d5e3-4589-8cdb-5114c48cd46e admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:06.046225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3da846-d5e3-4589-8cdb-5114c48cd46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:06.046823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3da846-d5e3-4589-8cdb-5114c48cd46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:06.047740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3da846-d5e3-4589-8cdb-5114c48cd46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:06.050276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3da846-d5e3-4589-8cdb-5114c48cd46e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:06.063062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1014/2040] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:06.068437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa4e71-bec3-432f-a741-7f37e260e9c8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:06.078935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa4e71-bec3-432f-a741-7f37e260e9c8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:06.083919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:06.084813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:06.085091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:06.085364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] PATH_INFO: `/v3/projects/8d79c328d68b44c9aaaf525b528dcf5e/users/6c1bb5040d264f0daa84d40f6729fb30/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:06.087384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d79c328d68b44c9aaaf525b528dcf5e, user_id=6c1bb5040d264f0daa84d40f6729fb30, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:06.090099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:06.110368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1027/2041] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:06 2022] PUT /identity/v3/projects/8d79c328d68b44c9aaaf525b528dcf5e/users/6c1bb5040d264f0daa84d40f6729fb30/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:06.120654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f698e-4b84-4df9-8b49-b1e99016efa5 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:06.120946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f698e-4b84-4df9-8b49-b1e99016efa5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:06.121260 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f698e-4b84-4df9-8b49-b1e99016efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:06.148027 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c30f698e-4b84-4df9-8b49-b1e99016efa5 None None] MFA Rules not processed for user `6c1bb5040d264f0daa84d40f6729fb30`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:06.149268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c30f698e-4b84-4df9-8b49-b1e99016efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:06.240903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1015/2042] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:06.254428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:06.258947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:06.338099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b42e0b-e637-484c-b6ab-76a6c7500e78 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:06.342523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f8c68-101b-4d3d-aee0-59ca092577a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:06.343435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f8c68-101b-4d3d-aee0-59ca092577a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:06.343818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f8c68-101b-4d3d-aee0-59ca092577a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:06.344247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f8c68-101b-4d3d-aee0-59ca092577a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:06.359875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f8c68-101b-4d3d-aee0-59ca092577a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:06.362782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f8c68-101b-4d3d-aee0-59ca092577a8 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:06.372397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1028/2043] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:06.448691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f698e-4b84-4df9-8b49-b1e99016efa5 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:06.450299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c30f698e-4b84-4df9-8b49-b1e99016efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:06.457594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:06.463649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f698e-4b84-4df9-8b49-b1e99016efa5 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:06.467776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37abab-47c1-4c61-ab87-477b5a48ba5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:06.468515 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37abab-47c1-4c61-ab87-477b5a48ba5f service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:06.468857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37abab-47c1-4c61-ab87-477b5a48ba5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:06.469197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37abab-47c1-4c61-ab87-477b5a48ba5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:06.530287 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37abab-47c1-4c61-ab87-477b5a48ba5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:06.531974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37abab-47c1-4c61-ab87-477b5a48ba5f service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:06.542798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1016/2044] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:06.823648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f8c68-101b-4d3d-aee0-59ca092577a8 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:06.889193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f8c68-101b-4d3d-aee0-59ca092577a8 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:06.893938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:06.894843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:06.895127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:06.895409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] PATH_INFO: `/v3/users/52eb4f5106c9404d97965b092506ce08` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:06.896580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=52eb4f5106c9404d97965b092506ce08)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:06.898574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:06.951705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52eb4f5106c9404d97965b092506ce08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:06.952494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52eb4f5106c9404d97965b092506ce08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:06.954224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:06.961366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52eb4f5106c9404d97965b092506ce08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:06.969499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52eb4f5106c9404d97965b092506ce08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:06.981218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52eb4f5106c9404d97965b092506ce08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:06.987236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1029/2045] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:06 2022] DELETE /identity/v3/users/52eb4f5106c9404d97965b092506ce08 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:06.993127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e13d-7128-4ea8-95dd-7385ec441c72 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:06.993649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e13d-7128-4ea8-95dd-7385ec441c72 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:06.993736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e13d-7128-4ea8-95dd-7385ec441c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:07.014297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f4f9e13d-7128-4ea8-95dd-7385ec441c72 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:07.015516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f4f9e13d-7128-4ea8-95dd-7385ec441c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:07.079349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1017/2046] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:07.089086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:07.090628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:07.153200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1518-d489-4c80-9093-333f7526fc3d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:07.156984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae52fb-083d-4446-ae39-779eb0418977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:07.157640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae52fb-083d-4446-ae39-779eb0418977 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:07.157953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae52fb-083d-4446-ae39-779eb0418977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:07.158229 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae52fb-083d-4446-ae39-779eb0418977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:07.167879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae52fb-083d-4446-ae39-779eb0418977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:07.169310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae52fb-083d-4446-ae39-779eb0418977 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:07.179269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1030/2047] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:07.451779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e13d-7128-4ea8-95dd-7385ec441c72 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:07.453422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f4f9e13d-7128-4ea8-95dd-7385ec441c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:07.467066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e13d-7128-4ea8-95dd-7385ec441c72 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:07.471988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:07.472911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:07.473190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:07.473481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] PATH_INFO: `/v3/projects/7c3ad7643fd54090a5b447fe618a47fb` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:07.474712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3ad7643fd54090a5b447fe618a47fb)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:07.477709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:07.533208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3ad7643fd54090a5b447fe618a47fb', 'request_id': 'req-fbce6a45-2947-410c-8c4d-0e4161741c96'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.539472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3ad7643fd54090a5b447fe618a47fb', 'request_id': 'req-fbce6a45-2947-410c-8c4d-0e4161741c96'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.545583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3ad7643fd54090a5b447fe618a47fb', 'request_id': 'req-fbce6a45-2947-410c-8c4d-0e4161741c96'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.560058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] The token cache is being invalidate because project 7c3ad7643fd54090a5b447fe618a47fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:07.560349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.560975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.562659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1018/2048] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:07 2022] DELETE /identity/v3/projects/7c3ad7643fd54090a5b447fe618a47fb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:07.567211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae52fb-083d-4446-ae39-779eb0418977 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:07.577005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae52fb-083d-4446-ae39-779eb0418977 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:07.637302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:07.638232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:07.638540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:07.638811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] PATH_INFO: `/v3/users/6c1bb5040d264f0daa84d40f6729fb30` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:07.640104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c1bb5040d264f0daa84d40f6729fb30)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:07.642103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:07.694060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c1bb5040d264f0daa84d40f6729fb30'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.695007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c1bb5040d264f0daa84d40f6729fb30'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.704314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c1bb5040d264f0daa84d40f6729fb30'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.712379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c1bb5040d264f0daa84d40f6729fb30'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.717693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:07.726248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5f6394d8-b8e4-4b27-830b-bc3dad6c2a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c1bb5040d264f0daa84d40f6729fb30'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:07.732906 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1031/2049] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:07 2022] DELETE /identity/v3/users/6c1bb5040d264f0daa84d40f6729fb30 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:08.021546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.023670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:08.043809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce6a45-2947-410c-8c4d-0e4161741c96 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.065345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:08.108082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.108965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.109245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.109490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] PATH_INFO: `/v3/projects/8d79c328d68b44c9aaaf525b528dcf5e` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.110698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d79c328d68b44c9aaaf525b528dcf5e)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.112814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.165976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d79c328d68b44c9aaaf525b528dcf5e', 'request_id': 'req-9e27cbee-7412-4bce-8373-e8159b102e9f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:08.175294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d79c328d68b44c9aaaf525b528dcf5e', 'request_id': 'req-9e27cbee-7412-4bce-8373-e8159b102e9f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:08.181822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d79c328d68b44c9aaaf525b528dcf5e', 'request_id': 'req-9e27cbee-7412-4bce-8373-e8159b102e9f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:08.196660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] The token cache is being invalidate because project 8d79c328d68b44c9aaaf525b528dcf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:08.196950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:08.197570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9e27cbee-7412-4bce-8373-e8159b102e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:08.199153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1019/2050] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:08 2022] DELETE /identity/v3/projects/8d79c328d68b44c9aaaf525b528dcf5e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:08.204271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6310-e055-4093-9311-9cd2700b6291 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.204790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6310-e055-4093-9311-9cd2700b6291 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.204899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6310-e055-4093-9311-9cd2700b6291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.223903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-87ef6310-e055-4093-9311-9cd2700b6291 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:08.225169 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-87ef6310-e055-4093-9311-9cd2700b6291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:08.289370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1032/2051] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:08.298384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f0ea-534b-4ff5-8a11-132977f293c4 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.298894 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f0ea-534b-4ff5-8a11-132977f293c4 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.299177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219f0ea-534b-4ff5-8a11-132977f293c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.319095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9219f0ea-534b-4ff5-8a11-132977f293c4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:08.320973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9219f0ea-534b-4ff5-8a11-132977f293c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:08.332082 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1020/2052] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:08.336636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef6310-e055-4093-9311-9cd2700b6291 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.346546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef6310-e055-4093-9311-9cd2700b6291 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.351467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.352136 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.352427 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.352688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.353401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:08.353750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.355329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.371351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1033/2053] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:13:08.372593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219f0ea-534b-4ff5-8a11-132977f293c4 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.382742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219f0ea-534b-4ff5-8a11-132977f293c4 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.387494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbd2af-ef51-4d0c-92e2-bb6302e331c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.388215 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbd2af-ef51-4d0c-92e2-bb6302e331c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.388493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbd2af-ef51-4d0c-92e2-bb6302e331c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.388767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbd2af-ef51-4d0c-92e2-bb6302e331c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.389458 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbd2af-ef51-4d0c-92e2-bb6302e331c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.391392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbd2af-ef51-4d0c-92e2-bb6302e331c1 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.427863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1021/2054] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:08 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:08.429769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.440994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2a8bd-1974-4a3c-af63-80ad1a3cdfa3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.501201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1b2f-4e3c-4f8a-b010-9aa32b2beaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.501946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1b2f-4e3c-4f8a-b010-9aa32b2beaec admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.502223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1b2f-4e3c-4f8a-b010-9aa32b2beaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.502594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1b2f-4e3c-4f8a-b010-9aa32b2beaec admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.503354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f1b2f-4e3c-4f8a-b010-9aa32b2beaec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.505286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f1b2f-4e3c-4f8a-b010-9aa32b2beaec admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.526405 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1034/2055] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:08 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:08.531380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbd2af-ef51-4d0c-92e2-bb6302e331c1 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.542762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbd2af-ef51-4d0c-92e2-bb6302e331c1 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.548000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50bb14-a728-4e68-8828-711967b44edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.548680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bb14-a728-4e68-8828-711967b44edd admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.548960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bb14-a728-4e68-8828-711967b44edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.549234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50bb14-a728-4e68-8828-711967b44edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.550191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50bb14-a728-4e68-8828-711967b44edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.551815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50bb14-a728-4e68-8828-711967b44edd admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.562673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1022/2056] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:08.567391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1b2f-4e3c-4f8a-b010-9aa32b2beaec admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.578220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1b2f-4e3c-4f8a-b010-9aa32b2beaec admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.584663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820eaa-8683-440e-a95c-7b251a7adafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.585301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820eaa-8683-440e-a95c-7b251a7adafd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.585605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820eaa-8683-440e-a95c-7b251a7adafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.585909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820eaa-8683-440e-a95c-7b251a7adafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.586721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820eaa-8683-440e-a95c-7b251a7adafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.588314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820eaa-8683-440e-a95c-7b251a7adafd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.598964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1035/2057] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:08.603113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50bb14-a728-4e68-8828-711967b44edd admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.613730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50bb14-a728-4e68-8828-711967b44edd admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.619291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210df80-2020-4bc1-a0f1-a22683ade2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.620212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210df80-2020-4bc1-a0f1-a22683ade2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.620487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210df80-2020-4bc1-a0f1-a22683ade2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.620756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210df80-2020-4bc1-a0f1-a22683ade2a8 admin admin] PATH_INFO: `/v3/projects/2d642b6175354628a304a0e9a1a02121/users/b986c913656b48ae86a33d99762a2cf1/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.635873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210df80-2020-4bc1-a0f1-a22683ade2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d642b6175354628a304a0e9a1a02121, user_id=b986c913656b48ae86a33d99762a2cf1, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.638569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210df80-2020-4bc1-a0f1-a22683ade2a8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.654659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1023/2058] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:08 2022] PUT /identity/v3/projects/2d642b6175354628a304a0e9a1a02121/users/b986c913656b48ae86a33d99762a2cf1/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:08.665138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c05d0-f118-42d0-a991-ac49e7f93145 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.665433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c05d0-f118-42d0-a991-ac49e7f93145 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.665726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c05d0-f118-42d0-a991-ac49e7f93145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.694245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-222c05d0-f118-42d0-a991-ac49e7f93145 None None] MFA Rules not processed for user `b986c913656b48ae86a33d99762a2cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:08.695482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-222c05d0-f118-42d0-a991-ac49e7f93145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:08.741395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:08.764022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1036/2059] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:08.768746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210df80-2020-4bc1-a0f1-a22683ade2a8 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.822037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:08.835252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210df80-2020-4bc1-a0f1-a22683ade2a8 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.840928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f674ecc-8100-425f-a3f2-2d393b092be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.841544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674ecc-8100-425f-a3f2-2d393b092be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.841855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674ecc-8100-425f-a3f2-2d393b092be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.842142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674ecc-8100-425f-a3f2-2d393b092be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.842843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f674ecc-8100-425f-a3f2-2d393b092be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.845155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f674ecc-8100-425f-a3f2-2d393b092be6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.877178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1024/2060] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:08 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:08.878546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c05d0-f118-42d0-a991-ac49e7f93145 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.889726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c05d0-f118-42d0-a991-ac49e7f93145 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.948894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35763b72-27a2-4f11-a759-414abb1a2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.949567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763b72-27a2-4f11-a759-414abb1a2c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.949959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763b72-27a2-4f11-a759-414abb1a2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.950236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763b72-27a2-4f11-a759-414abb1a2c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.950930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35763b72-27a2-4f11-a759-414abb1a2c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.952852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35763b72-27a2-4f11-a759-414abb1a2c7d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:08.973527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1037/2061] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:08 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:08.977814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f674ecc-8100-425f-a3f2-2d393b092be6 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:08.988953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f674ecc-8100-425f-a3f2-2d393b092be6 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:08.994537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e348-43fd-4bac-9b4b-d58defbfe57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:08.995209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e348-43fd-4bac-9b4b-d58defbfe57d admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:08.995485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e348-43fd-4bac-9b4b-d58defbfe57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:08.995753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0e348-43fd-4bac-9b4b-d58defbfe57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:08.996480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e348-43fd-4bac-9b4b-d58defbfe57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:08.998143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0e348-43fd-4bac-9b4b-d58defbfe57d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.010158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1025/2062] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:09.014602 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35763b72-27a2-4f11-a759-414abb1a2c7d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.025428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35763b72-27a2-4f11-a759-414abb1a2c7d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.031151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4dd47f-9b36-4e77-9618-94c0186118d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.031817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd47f-9b36-4e77-9618-94c0186118d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.032101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd47f-9b36-4e77-9618-94c0186118d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.032363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dd47f-9b36-4e77-9618-94c0186118d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.033097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dd47f-9b36-4e77-9618-94c0186118d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.034839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4dd47f-9b36-4e77-9618-94c0186118d8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.045245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1038/2063] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:09.049994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e348-43fd-4bac-9b4b-d58defbfe57d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.060899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0e348-43fd-4bac-9b4b-d58defbfe57d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.067450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edcbce-fa9c-4841-811b-5a9d7d55c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.068351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edcbce-fa9c-4841-811b-5a9d7d55c65b admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.068632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edcbce-fa9c-4841-811b-5a9d7d55c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.068909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edcbce-fa9c-4841-811b-5a9d7d55c65b admin admin] PATH_INFO: `/v3/projects/3471326561f44d809b739bd2647b1034/users/977f02b87d5648708faa4a5fac519836/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.084922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edcbce-fa9c-4841-811b-5a9d7d55c65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3471326561f44d809b739bd2647b1034, user_id=977f02b87d5648708faa4a5fac519836, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.087669 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edcbce-fa9c-4841-811b-5a9d7d55c65b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.102869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1026/2064] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:09 2022] PUT /identity/v3/projects/3471326561f44d809b739bd2647b1034/users/977f02b87d5648708faa4a5fac519836/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:09.114309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8932-d350-40df-a422-3b62d7ed88fc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.114653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8932-d350-40df-a422-3b62d7ed88fc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.114935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8932-d350-40df-a422-3b62d7ed88fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.143797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6f3e8932-d350-40df-a422-3b62d7ed88fc None None] MFA Rules not processed for user `977f02b87d5648708faa4a5fac519836`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:09.145042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6f3e8932-d350-40df-a422-3b62d7ed88fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:09.212753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1039/2065] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:09.217428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edcbce-fa9c-4841-811b-5a9d7d55c65b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.282762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edcbce-fa9c-4841-811b-5a9d7d55c65b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.289049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9fa55-2a84-4ea9-9be5-361444d9037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.289705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9fa55-2a84-4ea9-9be5-361444d9037b admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.290019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9fa55-2a84-4ea9-9be5-361444d9037b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.290326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9fa55-2a84-4ea9-9be5-361444d9037b admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.291019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9fa55-2a84-4ea9-9be5-361444d9037b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.292943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9fa55-2a84-4ea9-9be5-361444d9037b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.323655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1027/2066] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:09 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:09.327965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e8932-d350-40df-a422-3b62d7ed88fc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.339864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e8932-d350-40df-a422-3b62d7ed88fc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.391345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:09.403085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994e16-40be-4529-ab36-96e94143e09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.403885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994e16-40be-4529-ab36-96e94143e09e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.404294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994e16-40be-4529-ab36-96e94143e09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.404573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3994e16-40be-4529-ab36-96e94143e09e admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.405285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3994e16-40be-4529-ab36-96e94143e09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.407277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3994e16-40be-4529-ab36-96e94143e09e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.432931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1040/2067] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:09 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:09.434189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9fa55-2a84-4ea9-9be5-361444d9037b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.445363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9fa55-2a84-4ea9-9be5-361444d9037b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.450245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8ec37-f652-4bf0-84aa-60066f9dcc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.451077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ec37-f652-4bf0-84aa-60066f9dcc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.451390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ec37-f652-4bf0-84aa-60066f9dcc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.451666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ec37-f652-4bf0-84aa-60066f9dcc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.452425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8ec37-f652-4bf0-84aa-60066f9dcc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.454111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8ec37-f652-4bf0-84aa-60066f9dcc04 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.465288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1028/2068] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:09.469317 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994e16-40be-4529-ab36-96e94143e09e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.479984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3994e16-40be-4529-ab36-96e94143e09e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.485263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9816e5-8eec-4253-91b7-281d839a8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.486245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9816e5-8eec-4253-91b7-281d839a8ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.486525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9816e5-8eec-4253-91b7-281d839a8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.486860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9816e5-8eec-4253-91b7-281d839a8ec1 admin admin] PATH_INFO: `/v3/projects/49eb21b29f3e4ffeb0595869ffcd24ff/users/a984466fda26429ebc824875eb1b3057/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.503539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9816e5-8eec-4253-91b7-281d839a8ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49eb21b29f3e4ffeb0595869ffcd24ff, user_id=a984466fda26429ebc824875eb1b3057, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.506284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9816e5-8eec-4253-91b7-281d839a8ec1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.526266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1041/2069] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:09 2022] PUT /identity/v3/projects/49eb21b29f3e4ffeb0595869ffcd24ff/users/a984466fda26429ebc824875eb1b3057/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:09.527062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8ec37-f652-4bf0-84aa-60066f9dcc04 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.538735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8ec37-f652-4bf0-84aa-60066f9dcc04 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.610597 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee01ab0-5cab-4fb2-9855-438ee1912da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.611281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee01ab0-5cab-4fb2-9855-438ee1912da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.611563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee01ab0-5cab-4fb2-9855-438ee1912da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.611901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee01ab0-5cab-4fb2-9855-438ee1912da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.612658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee01ab0-5cab-4fb2-9855-438ee1912da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.614335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee01ab0-5cab-4fb2-9855-438ee1912da8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.624064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1029/2070] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:09.628368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9816e5-8eec-4253-91b7-281d839a8ec1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.638667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9816e5-8eec-4253-91b7-281d839a8ec1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.643311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.644197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.644477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.644753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] PATH_INFO: `/v3/projects/49eb21b29f3e4ffeb0595869ffcd24ff/users/a984466fda26429ebc824875eb1b3057/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.646854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49eb21b29f3e4ffeb0595869ffcd24ff, user_id=a984466fda26429ebc824875eb1b3057, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.649478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.660895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1042/2071] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:09 2022] PUT /identity/v3/projects/49eb21b29f3e4ffeb0595869ffcd24ff/users/a984466fda26429ebc824875eb1b3057/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:09.671314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd4d35-69ec-410d-b7df-2a9ddb617ed2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.671607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd4d35-69ec-410d-b7df-2a9ddb617ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.671884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd4d35-69ec-410d-b7df-2a9ddb617ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.693415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:09.702332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c1fd4d35-69ec-410d-b7df-2a9ddb617ed2 None None] MFA Rules not processed for user `a984466fda26429ebc824875eb1b3057`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:09.704233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c1fd4d35-69ec-410d-b7df-2a9ddb617ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:09.772117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1030/2072] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:09.783491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:09.785960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:09.851085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131d1a3-0fd0-4669-9fa2-5cd5654c0d34 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:09.855650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:09.856287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:09.856566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:09.856838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:09.918912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:09.920356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:09.930319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1043/2073] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:13.560308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd4d35-69ec-410d-b7df-2a9ddb617ed2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:13.561757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c1fd4d35-69ec-410d-b7df-2a9ddb617ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:13.575130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd4d35-69ec-410d-b7df-2a9ddb617ed2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:13.578966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af1f8c-95d7-4eb6-8477-8b5b94f6629e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:13.579617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af1f8c-95d7-4eb6-8477-8b5b94f6629e service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:13.579913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af1f8c-95d7-4eb6-8477-8b5b94f6629e service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:13.580415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af1f8c-95d7-4eb6-8477-8b5b94f6629e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:13.652642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af1f8c-95d7-4eb6-8477-8b5b94f6629e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:13.654133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af1f8c-95d7-4eb6-8477-8b5b94f6629e service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:13.663927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1031/2074] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:14.332734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:14.334624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:14.421037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:14.426880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc91f-acbe-4af1-9bce-6de0df2867e5 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:14.439059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:14.440759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:14.441208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:14.441628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] PATH_INFO: `/v3/users/d571990a1f4c4225ba9e23304bdc835f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:14.443051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d571990a1f4c4225ba9e23304bdc835f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:14.445225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:14.515400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af1f8c-95d7-4eb6-8477-8b5b94f6629e service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:14.523074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd571990a1f4c4225ba9e23304bdc835f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:14.523740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd571990a1f4c4225ba9e23304bdc835f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:14.525070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af1f8c-95d7-4eb6-8477-8b5b94f6629e service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:14.529492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155638b-bd59-4740-92de-b9ad21dfca20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:14.530835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155638b-bd59-4740-92de-b9ad21dfca20 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:14.531125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155638b-bd59-4740-92de-b9ad21dfca20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:14.531444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155638b-bd59-4740-92de-b9ad21dfca20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:14.533931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd571990a1f4c4225ba9e23304bdc835f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:14.541632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155638b-bd59-4740-92de-b9ad21dfca20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:14.542475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd571990a1f4c4225ba9e23304bdc835f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:14.543252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155638b-bd59-4740-92de-b9ad21dfca20 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:14.553968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1032/2075] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:14.561733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd571990a1f4c4225ba9e23304bdc835f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:14.570870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1044/2076] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:14 2022] DELETE /identity/v3/users/d571990a1f4c4225ba9e23304bdc835f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:14.576520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974170c-3d8e-407f-8f65-fdf2d431f695 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:14.577021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974170c-3d8e-407f-8f65-fdf2d431f695 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:14.577142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974170c-3d8e-407f-8f65-fdf2d431f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:14.599646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b974170c-3d8e-407f-8f65-fdf2d431f695 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:14.601406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b974170c-3d8e-407f-8f65-fdf2d431f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:14.704619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1033/2077] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:14.714532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:14.716033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:14.787472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec8a7d-d5cf-405c-b142-958eb55f8f39 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:14.791069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721f501-1460-412e-ac97-19f54d141165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:14.791720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f501-1460-412e-ac97-19f54d141165 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:14.791994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f501-1460-412e-ac97-19f54d141165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:14.792421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721f501-1460-412e-ac97-19f54d141165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:14.803710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721f501-1460-412e-ac97-19f54d141165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:14.805228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721f501-1460-412e-ac97-19f54d141165 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:14.816062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1045/2078] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:15.186111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974170c-3d8e-407f-8f65-fdf2d431f695 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:15.187613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b974170c-3d8e-407f-8f65-fdf2d431f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:15.200401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974170c-3d8e-407f-8f65-fdf2d431f695 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:15.206470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:15.207362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:15.207795 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:15.208061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] PATH_INFO: `/v3/projects/53504a5c5e3149c897114da1864e109c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:15.209521 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=53504a5c5e3149c897114da1864e109c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:15.211611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:15.230036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:15.269293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53504a5c5e3149c897114da1864e109c', 'request_id': 'req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.274745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53504a5c5e3149c897114da1864e109c', 'request_id': 'req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.281181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53504a5c5e3149c897114da1864e109c', 'request_id': 'req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.295061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] The token cache is being invalidate because project 53504a5c5e3149c897114da1864e109c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:15.295353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.295968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.297698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1034/2079] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:15 2022] DELETE /identity/v3/projects/53504a5c5e3149c897114da1864e109c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:15.301930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721f501-1460-412e-ac97-19f54d141165 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:15.312380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721f501-1460-412e-ac97-19f54d141165 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:15.388429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:15.390395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:15.390824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:15.391300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] PATH_INFO: `/v3/users/d5e135128aec4cbe9f3868b269fbc6c7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:15.393091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e135128aec4cbe9f3868b269fbc6c7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:15.395573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:15.420744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:15.453112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e135128aec4cbe9f3868b269fbc6c7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.453771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e135128aec4cbe9f3868b269fbc6c7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.463828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e135128aec4cbe9f3868b269fbc6c7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.473860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e135128aec4cbe9f3868b269fbc6c7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.489017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e135128aec4cbe9f3868b269fbc6c7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:15.495309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1046/2080] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:15 2022] DELETE /identity/v3/users/d5e135128aec4cbe9f3868b269fbc6c7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:15.837115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:15.839655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:15.861986 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2a64-be1f-4a0f-b3bd-e70a3fb8d8dd admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:15.961293 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:15.963014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:15.990418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:15.991335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:15.991674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:15.991994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] PATH_INFO: `/v3/projects/6597c9e7f6f440d09625d00ef85f63e1` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:15.994665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6597c9e7f6f440d09625d00ef85f63e1)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:15.998128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.092987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6597c9e7f6f440d09625d00ef85f63e1', 'request_id': 'req-6a50d2cf-f424-47b6-a48a-bec77edef562'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.096407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edaa31-ec62-4e22-831d-30b7aaead347 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:16.099932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6597c9e7f6f440d09625d00ef85f63e1', 'request_id': 'req-6a50d2cf-f424-47b6-a48a-bec77edef562'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.108590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6597c9e7f6f440d09625d00ef85f63e1', 'request_id': 'req-6a50d2cf-f424-47b6-a48a-bec77edef562'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.134262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] The token cache is being invalidate because project 6597c9e7f6f440d09625d00ef85f63e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:16.134820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.135779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6a50d2cf-f424-47b6-a48a-bec77edef562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.138004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1035/2081] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:15 2022] DELETE /identity/v3/projects/6597c9e7f6f440d09625d00ef85f63e1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:16.144602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a421a-f526-43b7-9a35-3c26f562fb67 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.145099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a421a-f526-43b7-9a35-3c26f562fb67 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.145590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a421a-f526-43b7-9a35-3c26f562fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.211049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-033a421a-f526-43b7-9a35-3c26f562fb67 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:16.212928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-033a421a-f526-43b7-9a35-3c26f562fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:16.253089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:16.254037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.254323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.254600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] PATH_INFO: `/v3/users/f56c0a6e51d24da5bf2d89b79f33192b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.255903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56c0a6e51d24da5bf2d89b79f33192b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:16.258056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.308611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:16.379907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56c0a6e51d24da5bf2d89b79f33192b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.380820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56c0a6e51d24da5bf2d89b79f33192b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.382869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:16.394897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1036/2082] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:16.394897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a421a-f526-43b7-9a35-3c26f562fb67 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:16.396621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-033a421a-f526-43b7-9a35-3c26f562fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:16.402989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56c0a6e51d24da5bf2d89b79f33192b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.413121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a421a-f526-43b7-9a35-3c26f562fb67 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:16.414260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56c0a6e51d24da5bf2d89b79f33192b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.418717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:16.419699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.420053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.420401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] PATH_INFO: `/v3/users/9092152890b643dfba02a1c4d99bd4d9` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.422056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9092152890b643dfba02a1c4d99bd4d9)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:16.424036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.430813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-56f3c92c-b768-41aa-8da7-7d4acb0638f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56c0a6e51d24da5bf2d89b79f33192b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.440350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1047/2083] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:15 2022] DELETE /identity/v3/users/f56c0a6e51d24da5bf2d89b79f33192b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:16.441669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd4c5-7367-45ec-824f-03095efb0470 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.441988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd4c5-7367-45ec-824f-03095efb0470 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.442345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd4c5-7367-45ec-824f-03095efb0470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.465236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-943bd4c5-7367-45ec-824f-03095efb0470 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:16.467050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-943bd4c5-7367-45ec-824f-03095efb0470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:16.494063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9092152890b643dfba02a1c4d99bd4d9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.504187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9092152890b643dfba02a1c4d99bd4d9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.518599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9092152890b643dfba02a1c4d99bd4d9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.525980 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9092152890b643dfba02a1c4d99bd4d9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.526702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9092152890b643dfba02a1c4d99bd4d9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:16.529322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1048/2084] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:16.530727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19000a9-afb2-4a99-ad12-72a45b01722e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.531013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19000a9-afb2-4a99-ad12-72a45b01722e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.531301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19000a9-afb2-4a99-ad12-72a45b01722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.533994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1037/2085] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:16 2022] DELETE /identity/v3/users/9092152890b643dfba02a1c4d99bd4d9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:16.537166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:16.537166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:16.551540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f19000a9-afb2-4a99-ad12-72a45b01722e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:16.552765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f19000a9-afb2-4a99-ad12-72a45b01722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:16.618530 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51ac57-a7d0-437a-9e99-5beb0ee0d1f8 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:16.625582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1049/2086] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:16.625582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47535-e2d6-42be-a3be-9dff916ce898 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.625582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47535-e2d6-42be-a3be-9dff916ce898 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.625582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47535-e2d6-42be-a3be-9dff916ce898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.630131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:16.630868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.631154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.631432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.632191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:16.632525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:16.634470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.648079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1038/2087] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:13:16.648959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:16.650852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:16.653240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2df47535-e2d6-42be-a3be-9dff916ce898 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:16.654451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2df47535-e2d6-42be-a3be-9dff916ce898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:16.662330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1050/2088] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:16.663279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df47535-e2d6-42be-a3be-9dff916ce898 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:16.675024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df47535-e2d6-42be-a3be-9dff916ce898 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:16.680355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:16.681506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.681787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.682166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.682874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:16.684815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.704299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:16.713320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1051/2089] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:16 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:16.714323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:16.717120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3194f8-975a-4d17-bad1-c2d8ee64bd67 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:16.717965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:16.766046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:16.778473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c257cf-fe6d-49ac-b27f-d29f7c796057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:16.779273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c257cf-fe6d-49ac-b27f-d29f7c796057 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.779553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c257cf-fe6d-49ac-b27f-d29f7c796057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.779893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c257cf-fe6d-49ac-b27f-d29f7c796057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.785698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8414b0c-8a15-471f-a26d-ffe12b362bda admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:16.789510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3752da-6b84-417c-81f6-45a5b9ce34f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:16.790195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3752da-6b84-417c-81f6-45a5b9ce34f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.790494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3752da-6b84-417c-81f6-45a5b9ce34f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.790748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3752da-6b84-417c-81f6-45a5b9ce34f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.857313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c257cf-fe6d-49ac-b27f-d29f7c796057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:16.858996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c257cf-fe6d-49ac-b27f-d29f7c796057 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.870247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3752da-6b84-417c-81f6-45a5b9ce34f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:16.871304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1039/2090] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:16.871879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3752da-6b84-417c-81f6-45a5b9ce34f8 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.872231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c257cf-fe6d-49ac-b27f-d29f7c796057 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:16.882910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1052/2091] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:16.883963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c257cf-fe6d-49ac-b27f-d29f7c796057 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:16.888805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995561f-1420-4800-bb2f-d255c6acf09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:16.889586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995561f-1420-4800-bb2f-d255c6acf09d admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.890164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995561f-1420-4800-bb2f-d255c6acf09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.890450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995561f-1420-4800-bb2f-d255c6acf09d admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.891629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995561f-1420-4800-bb2f-d255c6acf09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:16.893750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995561f-1420-4800-bb2f-d255c6acf09d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.920526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1040/2092] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:16 2022] POST /identity/v3/users => generated 294 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:16.924316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3752da-6b84-417c-81f6-45a5b9ce34f8 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:16.937873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3752da-6b84-417c-81f6-45a5b9ce34f8 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:16.964982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a98811-e5e4-4fc1-ba86-7997c3485862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:16.965751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98811-e5e4-4fc1-ba86-7997c3485862 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:16.966068 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98811-e5e4-4fc1-ba86-7997c3485862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:16.966523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98811-e5e4-4fc1-ba86-7997c3485862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:16.967979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98811-e5e4-4fc1-ba86-7997c3485862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:16.970118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98811-e5e4-4fc1-ba86-7997c3485862 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:16.985321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1053/2093] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:16.990609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995561f-1420-4800-bb2f-d255c6acf09d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:17.009953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995561f-1420-4800-bb2f-d255c6acf09d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:17.015207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f3617-5c15-4d93-83c6-2eb41ebbe3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:17.015900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f3617-5c15-4d93-83c6-2eb41ebbe3da admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.016181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f3617-5c15-4d93-83c6-2eb41ebbe3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.016511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f3617-5c15-4d93-83c6-2eb41ebbe3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.017259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f3617-5c15-4d93-83c6-2eb41ebbe3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:17.019084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f3617-5c15-4d93-83c6-2eb41ebbe3da admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:17.031142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1041/2094] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:17.036812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a98811-e5e4-4fc1-ba86-7997c3485862 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:17.049816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a98811-e5e4-4fc1-ba86-7997c3485862 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:17.055606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667f211-38c5-4d46-bfc1-fe9d3da69f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:17.056520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f211-38c5-4d46-bfc1-fe9d3da69f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.056803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f211-38c5-4d46-bfc1-fe9d3da69f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.057077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f211-38c5-4d46-bfc1-fe9d3da69f3d admin admin] PATH_INFO: `/v3/projects/e95bdc21e7114831aa96dec5e576f3d3/users/2ea721e2bdcf4359ab6b004aadc98d66/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.079199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667f211-38c5-4d46-bfc1-fe9d3da69f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95bdc21e7114831aa96dec5e576f3d3, user_id=2ea721e2bdcf4359ab6b004aadc98d66, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:17.082660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667f211-38c5-4d46-bfc1-fe9d3da69f3d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:17.105273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1054/2095] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:17 2022] PUT /identity/v3/projects/e95bdc21e7114831aa96dec5e576f3d3/users/2ea721e2bdcf4359ab6b004aadc98d66/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:17.117325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15cf8-18a9-4f3c-8b7d-d002e651619c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.117753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15cf8-18a9-4f3c-8b7d-d002e651619c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.118298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15cf8-18a9-4f3c-8b7d-d002e651619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.161320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e7f15cf8-18a9-4f3c-8b7d-d002e651619c None None] MFA Rules not processed for user `2ea721e2bdcf4359ab6b004aadc98d66`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:17.162760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e7f15cf8-18a9-4f3c-8b7d-d002e651619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:17.238729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1042/2096] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:17.243296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667f211-38c5-4d46-bfc1-fe9d3da69f3d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:17.349517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667f211-38c5-4d46-bfc1-fe9d3da69f3d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:17.364780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:17.365488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.365757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.366072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.367152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:17.370482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:17.405641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1055/2097] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:17 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:17.410136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f15cf8-18a9-4f3c-8b7d-d002e651619c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:17.431622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f15cf8-18a9-4f3c-8b7d-d002e651619c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:17.431786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:17.462533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:17.464620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:17.541375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:17.542052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:17.542263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.542633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.542925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.544734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:17.547201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:17.578043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd82f-e9f1-47f9-b062-6f5518f46bc1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:17.583970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:17.584941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.585230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.585505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] PATH_INFO: `/v3/projects/e372f09ce33e4bc48d5a1c687a745585` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.586790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e372f09ce33e4bc48d5a1c687a745585)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:17.588996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:17.596087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1043/2098] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:17 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:17.597111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:17.603262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:17.620967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83bf2a-dbb1-46bc-8bf3-936a1bd9f457 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:17.640061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:17.641313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.641883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.642304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] PATH_INFO: `/v3/projects/0c99ac56b91e4d5c88d6cf68aac43553` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.644299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c99ac56b91e4d5c88d6cf68aac43553)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:17.647310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:17.712846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e372f09ce33e4bc48d5a1c687a745585', 'request_id': 'req-5421d39b-476b-4fb5-8a81-f641f1b72dd3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.730597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e372f09ce33e4bc48d5a1c687a745585', 'request_id': 'req-5421d39b-476b-4fb5-8a81-f641f1b72dd3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.749400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e372f09ce33e4bc48d5a1c687a745585', 'request_id': 'req-5421d39b-476b-4fb5-8a81-f641f1b72dd3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.758954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c99ac56b91e4d5c88d6cf68aac43553', 'request_id': 'req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.768869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c99ac56b91e4d5c88d6cf68aac43553', 'request_id': 'req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.773482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] The token cache is being invalidate because project e372f09ce33e4bc48d5a1c687a745585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:17.777860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.778735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c99ac56b91e4d5c88d6cf68aac43553', 'request_id': 'req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.779767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.782927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1056/2099] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:17 2022] DELETE /identity/v3/projects/e372f09ce33e4bc48d5a1c687a745585 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:17.789050 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:17.793613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:17.803921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] The token cache is being invalidate because project 0c99ac56b91e4d5c88d6cf68aac43553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:17.816329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.819090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:17.826367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1044/2100] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:17 2022] DELETE /identity/v3/projects/0c99ac56b91e4d5c88d6cf68aac43553 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:17.826367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:17.828369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:17.921188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbfa8-c9ea-46bb-bf47-4c11a29788c3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:17.927060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:17.927976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.928255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.928532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] PATH_INFO: `/v3/users/001885178ebd48a689f53120c99f0298` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.929883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001885178ebd48a689f53120c99f0298)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:17.932048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:17.969167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:17.980258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421d39b-476b-4fb5-8a81-f641f1b72dd3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:17.991157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a973f7-15ed-476c-871f-54706323d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:17.991900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a973f7-15ed-476c-871f-54706323d438 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:17.992448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a973f7-15ed-476c-871f-54706323d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:17.992716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a973f7-15ed-476c-871f-54706323d438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:17.993669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a973f7-15ed-476c-871f-54706323d438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:17.995646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a973f7-15ed-476c-871f-54706323d438 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.004064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001885178ebd48a689f53120c99f0298'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.010816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1057/2101] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:18.010816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3e56-33e2-4c09-ac02-64f0edc530ea None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.012836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3e56-33e2-4c09-ac02-64f0edc530ea None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.012836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3e56-33e2-4c09-ac02-64f0edc530ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.024359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001885178ebd48a689f53120c99f0298'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.043128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001885178ebd48a689f53120c99f0298'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.043608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-37ee3e56-33e2-4c09-ac02-64f0edc530ea None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:18.045720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-37ee3e56-33e2-4c09-ac02-64f0edc530ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:18.052278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001885178ebd48a689f53120c99f0298'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.053038 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f91e0998-df62-41f8-adb3-d6412705d447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001885178ebd48a689f53120c99f0298'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.061606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1058/2102] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:18.063437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee3e56-33e2-4c09-ac02-64f0edc530ea None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.066514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-37ee3e56-33e2-4c09-ac02-64f0edc530ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:18.071898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1045/2103] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:17 2022] DELETE /identity/v3/users/001885178ebd48a689f53120c99f0298 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:18.073773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f428-e33e-446b-bde1-5c079d78d37e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.074087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f428-e33e-446b-bde1-5c079d78d37e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.074364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5f428-e33e-446b-bde1-5c079d78d37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.093225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee3e56-33e2-4c09-ac02-64f0edc530ea None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.111303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f5d5f428-e33e-446b-bde1-5c079d78d37e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:18.113735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f5d5f428-e33e-446b-bde1-5c079d78d37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:18.189530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:18.198604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7fc03-4b49-4ff1-8e4d-4163f32d5f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.199715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7fc03-4b49-4ff1-8e4d-4163f32d5f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.200028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7fc03-4b49-4ff1-8e4d-4163f32d5f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.200456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7fc03-4b49-4ff1-8e4d-4163f32d5f09 admin admin] PATH_INFO: `/v3/projects/b971e2d2950645ac9168671abfc2ed62/users/63471b36f8b24519a162d057d737488f/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.214480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1046/2104] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:18.220379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5f428-e33e-446b-bde1-5c079d78d37e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.232449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7fc03-4b49-4ff1-8e4d-4163f32d5f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971e2d2950645ac9168671abfc2ed62, user_id=63471b36f8b24519a162d057d737488f, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.232694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5f428-e33e-446b-bde1-5c079d78d37e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.236761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7fc03-4b49-4ff1-8e4d-4163f32d5f09 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.239977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.240754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.241032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.241319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.242125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:18.242459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.244300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.263782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1047/2105] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:13:18.266113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.267530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1059/2106] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:18 2022] PUT /identity/v3/projects/b971e2d2950645ac9168671abfc2ed62/users/63471b36f8b24519a162d057d737488f/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:18.272269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7fc03-4b49-4ff1-8e4d-4163f32d5f09 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.278191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836332d2-602d-4d72-87da-7e9ffb294d12 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.343862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ba94e-ac2a-4df7-b5b5-795a9e5d9929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.344578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba94e-ac2a-4df7-b5b5-795a9e5d9929 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.344861 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba94e-ac2a-4df7-b5b5-795a9e5d9929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.345135 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba94e-ac2a-4df7-b5b5-795a9e5d9929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.346666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ba94e-ac2a-4df7-b5b5-795a9e5d9929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.348711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ba94e-ac2a-4df7-b5b5-795a9e5d9929 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.361570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7fc03-4b49-4ff1-8e4d-4163f32d5f09 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.368915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d34885-160f-4bb9-95e5-cd7adc1a0427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.369934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d34885-160f-4bb9-95e5-cd7adc1a0427 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.370321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d34885-160f-4bb9-95e5-cd7adc1a0427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.370652 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d34885-160f-4bb9-95e5-cd7adc1a0427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.371557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d34885-160f-4bb9-95e5-cd7adc1a0427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.373402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d34885-160f-4bb9-95e5-cd7adc1a0427 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.385739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1048/2107] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:18 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:18.389313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1060/2108] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:18.389435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ba94e-ac2a-4df7-b5b5-795a9e5d9929 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.390400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d34885-160f-4bb9-95e5-cd7adc1a0427 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.402358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d34885-160f-4bb9-95e5-cd7adc1a0427 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.406580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:18.471160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ba94e-ac2a-4df7-b5b5-795a9e5d9929 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.476719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a80b8-f185-4ec7-8378-ede8f9c73a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.477420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a80b8-f185-4ec7-8378-ede8f9c73a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.478014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a80b8-f185-4ec7-8378-ede8f9c73a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.478296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a80b8-f185-4ec7-8378-ede8f9c73a9b admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.479128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a80b8-f185-4ec7-8378-ede8f9c73a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.481611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a80b8-f185-4ec7-8378-ede8f9c73a9b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.487931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.489595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.490137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.490607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] PATH_INFO: `/v3/projects/b971e2d2950645ac9168671abfc2ed62/users/63471b36f8b24519a162d057d737488f/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.493261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971e2d2950645ac9168671abfc2ed62, user_id=63471b36f8b24519a162d057d737488f, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.496973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.523872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1049/2110] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:18 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:18.523872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a80b8-f185-4ec7-8378-ede8f9c73a9b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.524448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1061/2110] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:18 2022] PUT /identity/v3/projects/b971e2d2950645ac9168671abfc2ed62/users/63471b36f8b24519a162d057d737488f/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:18.525681 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.528217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:18.543142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a80b8-f185-4ec7-8378-ede8f9c73a9b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.631231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68203c7-e609-4c6a-bafe-cc71bd23741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.632238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bab8-ba3c-4788-bbec-647576249b15 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.632573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68203c7-e609-4c6a-bafe-cc71bd23741e admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.633046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68203c7-e609-4c6a-bafe-cc71bd23741e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.633505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68203c7-e609-4c6a-bafe-cc71bd23741e admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.634759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68203c7-e609-4c6a-bafe-cc71bd23741e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.636806 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68203c7-e609-4c6a-bafe-cc71bd23741e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.640130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.641129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.641408 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.641727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] PATH_INFO: `/v3/projects/e87d2e3ad16f4f958a4f56219931095e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.643865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87d2e3ad16f4f958a4f56219931095e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.645886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.651068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1050/2111] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:18.652724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390ef2-76f2-4192-94bd-ae7c3773e8f4 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.653209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390ef2-76f2-4192-94bd-ae7c3773e8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.653720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390ef2-76f2-4192-94bd-ae7c3773e8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.663543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:18.688567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-8f390ef2-76f2-4192-94bd-ae7c3773e8f4 None None] MFA Rules not processed for user `63471b36f8b24519a162d057d737488f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:18.689635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8f390ef2-76f2-4192-94bd-ae7c3773e8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:18.743072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87d2e3ad16f4f958a4f56219931095e', 'request_id': 'req-607568c3-7cc0-4a14-989e-2bb7d2bb920a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.750260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87d2e3ad16f4f958a4f56219931095e', 'request_id': 'req-607568c3-7cc0-4a14-989e-2bb7d2bb920a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.758754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87d2e3ad16f4f958a4f56219931095e', 'request_id': 'req-607568c3-7cc0-4a14-989e-2bb7d2bb920a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.776344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] The token cache is being invalidate because project e87d2e3ad16f4f958a4f56219931095e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:18.776636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.781424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:18.783570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1062/2112] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:18 2022] DELETE /identity/v3/projects/e87d2e3ad16f4f958a4f56219931095e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:18.787788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.789255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:18.794508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1051/2113] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:18.796685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940de09-51d1-45a3-bb78-4b7dd0d43f99 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.797261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940de09-51d1-45a3-bb78-4b7dd0d43f99 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.798293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940de09-51d1-45a3-bb78-4b7dd0d43f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.823682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4940de09-51d1-45a3-bb78-4b7dd0d43f99 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:18.825773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4940de09-51d1-45a3-bb78-4b7dd0d43f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:18.858307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:18.879991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607568c3-7cc0-4a14-989e-2bb7d2bb920a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.886160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.886841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.888093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.888093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.889024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.891237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.904560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1063/2114] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:18.905493 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.910097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:18.918164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1052/2115] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:18.924761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940de09-51d1-45a3-bb78-4b7dd0d43f99 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:18.946919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940de09-51d1-45a3-bb78-4b7dd0d43f99 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:18.953227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b093bf-f14b-4859-b4e1-38b01ef58f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:18.954300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b093bf-f14b-4859-b4e1-38b01ef58f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:18.954580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b093bf-f14b-4859-b4e1-38b01ef58f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:18.954856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b093bf-f14b-4859-b4e1-38b01ef58f79 admin admin] PATH_INFO: `/v3/projects/aa636b31dd844b93b83300a3de1418ce/users/89d1af25b199404b9f432b21c825b447/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:18.973570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b093bf-f14b-4859-b4e1-38b01ef58f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa636b31dd844b93b83300a3de1418ce, user_id=89d1af25b199404b9f432b21c825b447, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:18.978937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b093bf-f14b-4859-b4e1-38b01ef58f79 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:18.997808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1053/2116] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:18 2022] PUT /identity/v3/projects/aa636b31dd844b93b83300a3de1418ce/users/89d1af25b199404b9f432b21c825b447/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:18.999682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84816-3ff6-42e0-974a-c83813521183 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.000045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84816-3ff6-42e0-974a-c83813521183 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.000342 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84816-3ff6-42e0-974a-c83813521183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.011029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c385-dcf5-40a0-b52a-5825e81ea436 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:19.026914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1df84816-3ff6-42e0-974a-c83813521183 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:19.029494 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1df84816-3ff6-42e0-974a-c83813521183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:19.076794 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:19.077890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.078311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.078554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.080605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:19.089059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:19.142002 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1054/2117] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:19.143882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac8f0-e078-4a76-97c8-cc73ab0be877 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.144001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac8f0-e078-4a76-97c8-cc73ab0be877 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.144264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac8f0-e078-4a76-97c8-cc73ab0be877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.177321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-bdaac8f0-e078-4a76-97c8-cc73ab0be877 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:19.178751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bdaac8f0-e078-4a76-97c8-cc73ab0be877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:19.194213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:19.196141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:19.205510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1055/2118] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:19.209491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac8f0-e078-4a76-97c8-cc73ab0be877 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:19.218214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1064/2119] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:19.220228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:19.223212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:19.232959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac8f0-e078-4a76-97c8-cc73ab0be877 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:19.246496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:19.248560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.248748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.249072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.249869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:19.250159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:19.256626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:19.257610 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5c23-2515-4a7f-9ba2-f2dd6e0c7e91 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:19.272964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:19.274660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.274953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.275236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] PATH_INFO: `/v3/users/b986c913656b48ae86a33d99762a2cf1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.278790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b986c913656b48ae86a33d99762a2cf1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:19.283099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:19.287743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1056/2120] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:13:19.291145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:19.294776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:19.405035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b986c913656b48ae86a33d99762a2cf1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:19.405924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b986c913656b48ae86a33d99762a2cf1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:19.417455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b986c913656b48ae86a33d99762a2cf1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:19.432668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b986c913656b48ae86a33d99762a2cf1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:19.448832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b986c913656b48ae86a33d99762a2cf1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:19.458902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1065/2121] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:19 2022] DELETE /identity/v3/users/b986c913656b48ae86a33d99762a2cf1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:19.464561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:19.466333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:19.477043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4184f-4598-4463-9cb2-7106cdb02616 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:19.555280 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:19.590565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:19.591692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.592000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.592256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.594780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:19.657510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd60a4d-1720-440e-ac75-566de817f14d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:19.667458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b08015-9286-42ed-9dd0-2c36e1039eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:19.668291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08015-9286-42ed-9dd0-2c36e1039eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.669554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08015-9286-42ed-9dd0-2c36e1039eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.671101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08015-9286-42ed-9dd0-2c36e1039eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.672009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b08015-9286-42ed-9dd0-2c36e1039eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:19.677751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b08015-9286-42ed-9dd0-2c36e1039eaf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:19.728054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:19.741485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1066/2122] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:19 2022] POST /identity/v3/projects => generated 365 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:19.746054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ca3f9-8259-4aad-8040-afd45e2e0ad3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.747246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ca3f9-8259-4aad-8040-afd45e2e0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.748688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ca3f9-8259-4aad-8040-afd45e2e0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.773701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-232ca3f9-8259-4aad-8040-afd45e2e0ad3 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:19.775108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-232ca3f9-8259-4aad-8040-afd45e2e0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:19.790024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:19.791786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:19.808019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1057/2123] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:19.808922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:19.820522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca662c93-036b-4958-81b3-99511601deaf service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:19.902829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54034194-60c8-4bb7-9d12-ee0f9af6569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:19.903736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54034194-60c8-4bb7-9d12-ee0f9af6569c admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.904192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54034194-60c8-4bb7-9d12-ee0f9af6569c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.904695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54034194-60c8-4bb7-9d12-ee0f9af6569c admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.905637 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54034194-60c8-4bb7-9d12-ee0f9af6569c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:19.908286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54034194-60c8-4bb7-9d12-ee0f9af6569c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:19.946087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1058/2124] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:19 2022] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:19.948051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54034194-60c8-4bb7-9d12-ee0f9af6569c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:19.977700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54034194-60c8-4bb7-9d12-ee0f9af6569c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:19.991633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641cda-c3c0-4201-bf5b-468e8a8008dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:19.993546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641cda-c3c0-4201-bf5b-468e8a8008dc admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:19.996697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641cda-c3c0-4201-bf5b-468e8a8008dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:19.996988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641cda-c3c0-4201-bf5b-468e8a8008dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:19.997884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67641cda-c3c0-4201-bf5b-468e8a8008dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:19.999730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67641cda-c3c0-4201-bf5b-468e8a8008dc admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:20.000247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1067/2125] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:20.010016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ca3f9-8259-4aad-8040-afd45e2e0ad3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:20.014689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-232ca3f9-8259-4aad-8040-afd45e2e0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:20.019206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1059/2126] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:20.026544 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641cda-c3c0-4201-bf5b-468e8a8008dc admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:20.043401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641cda-c3c0-4201-bf5b-468e8a8008dc admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:20.052783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d89252-dd8f-4a42-8db4-3fed5db8610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:20.053488 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89252-dd8f-4a42-8db4-3fed5db8610b admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:20.053893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89252-dd8f-4a42-8db4-3fed5db8610b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:20.054177 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89252-dd8f-4a42-8db4-3fed5db8610b admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:20.055569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d89252-dd8f-4a42-8db4-3fed5db8610b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:20.057665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d89252-dd8f-4a42-8db4-3fed5db8610b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:20.080855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1060/2127] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:20.086473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d89252-dd8f-4a42-8db4-3fed5db8610b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:20.106223 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d89252-dd8f-4a42-8db4-3fed5db8610b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:20.111301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2a685-f261-4af6-873f-a6b2ed7e9fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:20.112315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2a685-f261-4af6-873f-a6b2ed7e9fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:20.112804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2a685-f261-4af6-873f-a6b2ed7e9fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:20.113154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2a685-f261-4af6-873f-a6b2ed7e9fae admin admin] PATH_INFO: `/v3/projects/09b53232fd0245278ef9f7befc66e509/users/cbf627bb5d3d40539fa93f504856aac7/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:20.148783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2a685-f261-4af6-873f-a6b2ed7e9fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b53232fd0245278ef9f7befc66e509, user_id=cbf627bb5d3d40539fa93f504856aac7, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:20.153033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2a685-f261-4af6-873f-a6b2ed7e9fae admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:20.175893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ca3f9-8259-4aad-8040-afd45e2e0ad3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:20.187310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1061/2128] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:20 2022] PUT /identity/v3/projects/09b53232fd0245278ef9f7befc66e509/users/cbf627bb5d3d40539fa93f504856aac7/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:20.200321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92f12a-0f6f-4768-8363-12d14395e4aa None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:20.200911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92f12a-0f6f-4768-8363-12d14395e4aa None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:20.201193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92f12a-0f6f-4768-8363-12d14395e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:20.261482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-7f92f12a-0f6f-4768-8363-12d14395e4aa None None] MFA Rules not processed for user `cbf627bb5d3d40539fa93f504856aac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:20.270024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-7f92f12a-0f6f-4768-8363-12d14395e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:20.323292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:20.338622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:20.339302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:20.341856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:20.342152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:20.457071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1062/2129] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:20.462163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92f12a-0f6f-4768-8363-12d14395e4aa None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:20.500847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:20.502633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:20.520048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1068/2130] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:20.521612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:20.523037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:20.542694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee0aa8-2c49-4e1a-b2bb-0897126f369e service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:20.550354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:20.551483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:20.552137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:20.552801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] PATH_INFO: `/v3/users/2ea721e2bdcf4359ab6b004aadc98d66` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:20.554667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea721e2bdcf4359ab6b004aadc98d66)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:20.556921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:20.559210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:20.620266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92f12a-0f6f-4768-8363-12d14395e4aa None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:20.642240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f9663-98e5-4d64-aec7-27f9907df615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:20.643848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9663-98e5-4d64-aec7-27f9907df615 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:20.644096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9663-98e5-4d64-aec7-27f9907df615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:20.644373 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f9663-98e5-4d64-aec7-27f9907df615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:20.645120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f9663-98e5-4d64-aec7-27f9907df615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:20.647402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f9663-98e5-4d64-aec7-27f9907df615 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:20.662566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea721e2bdcf4359ab6b004aadc98d66'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:20.663823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea721e2bdcf4359ab6b004aadc98d66'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:20.689320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea721e2bdcf4359ab6b004aadc98d66'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:20.710917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea721e2bdcf4359ab6b004aadc98d66'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:20.742422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1063/2131] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:20 2022] POST /identity/v3/projects => generated 363 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:20.743570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f9663-98e5-4d64-aec7-27f9907df615 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:20.749365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a176c67d-20eb-490f-be66-49aa4c65f549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea721e2bdcf4359ab6b004aadc98d66'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:20.775180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1069/2132] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:20 2022] DELETE /identity/v3/users/2ea721e2bdcf4359ab6b004aadc98d66 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:20.778860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae983-9a61-42d3-a237-f3e53b3f1c1f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:20.779761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae983-9a61-42d3-a237-f3e53b3f1c1f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:20.780048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae983-9a61-42d3-a237-f3e53b3f1c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:20.826864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c36ae983-9a61-42d3-a237-f3e53b3f1c1f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:20.828385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c36ae983-9a61-42d3-a237-f3e53b3f1c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:20.847343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f9663-98e5-4d64-aec7-27f9907df615 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:20.945781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1070/2133] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:20.974634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae983-9a61-42d3-a237-f3e53b3f1c1f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:20.976457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c36ae983-9a61-42d3-a237-f3e53b3f1c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:20.998741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:21.031053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.032105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.033903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.034900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.036949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.040298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:21.086880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1064/2134] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:20 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:21.091032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae983-9a61-42d3-a237-f3e53b3f1c1f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:21.091234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:21.097692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:21.101006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad46a5f-b162-4f44-96ad-47b5adcf4ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.101739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad46a5f-b162-4f44-96ad-47b5adcf4ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.102097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad46a5f-b162-4f44-96ad-47b5adcf4ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.102385 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad46a5f-b162-4f44-96ad-47b5adcf4ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.120460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44f77e-c920-4271-8196-04b6b8a87d13 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:21.124671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad46a5f-b162-4f44-96ad-47b5adcf4ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.126308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad46a5f-b162-4f44-96ad-47b5adcf4ec7 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:21.137617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4d06-c2cd-4196-8f31-c4c09791e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.140379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4d06-c2cd-4196-8f31-c4c09791e93a admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.140670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4d06-c2cd-4196-8f31-c4c09791e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.140950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4d06-c2cd-4196-8f31-c4c09791e93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.142213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd4d06-c2cd-4196-8f31-c4c09791e93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.144419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1071/2135] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:21.144662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd4d06-c2cd-4196-8f31-c4c09791e93a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:21.170224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1065/2136] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:21.172701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad46a5f-b162-4f44-96ad-47b5adcf4ec7 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:21.183868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad46a5f-b162-4f44-96ad-47b5adcf4ec7 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:21.191366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d2975-278d-4350-b4a9-6bf12edf8148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.192622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2975-278d-4350-b4a9-6bf12edf8148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.193448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2975-278d-4350-b4a9-6bf12edf8148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.193920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2975-278d-4350-b4a9-6bf12edf8148 admin admin] PATH_INFO: `/v3/projects/6b8d24e6e02042e5bd37a17f4bc35b0f/users/f8a120d05a2240df9d6814cb29d75d93/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.215638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d2975-278d-4350-b4a9-6bf12edf8148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8d24e6e02042e5bd37a17f4bc35b0f, user_id=f8a120d05a2240df9d6814cb29d75d93, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.225151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d2975-278d-4350-b4a9-6bf12edf8148 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:21.245562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:21.262362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1072/2137] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:21 2022] PUT /identity/v3/projects/6b8d24e6e02042e5bd37a17f4bc35b0f/users/f8a120d05a2240df9d6814cb29d75d93/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:21.267351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4d06-c2cd-4196-8f31-c4c09791e93a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:21.282779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4d06-c2cd-4196-8f31-c4c09791e93a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:21.307938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37a5e-269f-4225-92ce-deb5204d7956 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.308243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37a5e-269f-4225-92ce-deb5204d7956 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.308521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37a5e-269f-4225-92ce-deb5204d7956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.367511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7da37a5e-269f-4225-92ce-deb5204d7956 None None] MFA Rules not processed for user `89d1af25b199404b9f432b21c825b447`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:21.370543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7da37a5e-269f-4225-92ce-deb5204d7956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:21.424858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431301-1599-4ece-99cb-b3fb56edad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.427636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431301-1599-4ece-99cb-b3fb56edad16 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.428327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431301-1599-4ece-99cb-b3fb56edad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.428787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431301-1599-4ece-99cb-b3fb56edad16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.429758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01431301-1599-4ece-99cb-b3fb56edad16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.432583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01431301-1599-4ece-99cb-b3fb56edad16 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:21.486356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1073/2138] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:21.501426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1066/2139] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:21.502798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da37a5e-269f-4225-92ce-deb5204d7956 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:21.503479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431301-1599-4ece-99cb-b3fb56edad16 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:21.506279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7da37a5e-269f-4225-92ce-deb5204d7956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:21.528142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431301-1599-4ece-99cb-b3fb56edad16 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:21.546705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d8e19-e47e-455e-881b-f004a62efaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.550484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d8e19-e47e-455e-881b-f004a62efaeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.550781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d8e19-e47e-455e-881b-f004a62efaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.551159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d8e19-e47e-455e-881b-f004a62efaeb admin admin] PATH_INFO: `/v3/projects/6b8d24e6e02042e5bd37a17f4bc35b0f/users/f8a120d05a2240df9d6814cb29d75d93/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.561432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d8e19-e47e-455e-881b-f004a62efaeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8d24e6e02042e5bd37a17f4bc35b0f, user_id=f8a120d05a2240df9d6814cb29d75d93, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.566989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d8e19-e47e-455e-881b-f004a62efaeb admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:21.588219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1067/2140] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:21 2022] PUT /identity/v3/projects/6b8d24e6e02042e5bd37a17f4bc35b0f/users/f8a120d05a2240df9d6814cb29d75d93/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:21.599833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cab82-1f06-48a0-8005-828018e5d1cc None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.600353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cab82-1f06-48a0-8005-828018e5d1cc None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.600772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cab82-1f06-48a0-8005-828018e5d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.632807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da37a5e-269f-4225-92ce-deb5204d7956 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:21.655923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-955cab82-1f06-48a0-8005-828018e5d1cc None None] MFA Rules not processed for user `f8a120d05a2240df9d6814cb29d75d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:21.657551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-955cab82-1f06-48a0-8005-828018e5d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:21.733038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.737573 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.738160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.738734 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.828035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1068/2141] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:21.829137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cab82-1f06-48a0-8005-828018e5d1cc None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:21.834054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-955cab82-1f06-48a0-8005-828018e5d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:21.862274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.863822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:21.867666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:21.877401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1074/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:21.878388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:21.879918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:21.916654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:21.951077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cab82-1f06-48a0-8005-828018e5d1cc None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:21.957719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.961899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.965501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.965812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] PATH_INFO: `/v3/projects/e95bdc21e7114831aa96dec5e576f3d3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.968715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95bdc21e7114831aa96dec5e576f3d3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.970983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:21.972472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc1bb4-272a-4cf3-b178-5b24d9977d2c service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:21.977423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:21.978428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:21.978755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:21.979120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] PATH_INFO: `/v3/projects/2d642b6175354628a304a0e9a1a02121` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:21.980295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d642b6175354628a304a0e9a1a02121)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:21.982361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:22.030945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95bdc21e7114831aa96dec5e576f3d3', 'request_id': 'req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.037046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95bdc21e7114831aa96dec5e576f3d3', 'request_id': 'req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.046207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95bdc21e7114831aa96dec5e576f3d3', 'request_id': 'req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.047072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d642b6175354628a304a0e9a1a02121', 'request_id': 'req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.056792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d642b6175354628a304a0e9a1a02121', 'request_id': 'req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.061535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] The token cache is being invalidate because project e95bdc21e7114831aa96dec5e576f3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:22.061848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.062487 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.064715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1069/2143] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:21 2022] DELETE /identity/v3/projects/e95bdc21e7114831aa96dec5e576f3d3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:22.065415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:22.067542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:22.070196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d642b6175354628a304a0e9a1a02121', 'request_id': 'req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.086789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] The token cache is being invalidate because project 2d642b6175354628a304a0e9a1a02121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:22.086971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.087606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.089568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1075/2144] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:21 2022] DELETE /identity/v3/projects/2d642b6175354628a304a0e9a1a02121 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:22.095533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:22.097567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:22.137173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b1e4-42b6-4bfc-9fbb-65b3a6c40b7c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:22.178673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da34c8-b2d0-4d00-a3a4-69d6fd72b8a3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:22.184479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:22.185433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:22.185841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:22.186220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] PATH_INFO: `/v3/users/63471b36f8b24519a162d057d737488f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:22.187670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63471b36f8b24519a162d057d737488f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:22.190142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:22.202348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:22.203455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:22.203740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:22.204147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:22.206990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:22.241513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:22.280129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63471b36f8b24519a162d057d737488f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.280898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63471b36f8b24519a162d057d737488f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.286243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:22.293227 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63471b36f8b24519a162d057d737488f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.307640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63471b36f8b24519a162d057d737488f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.333819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:22.336400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63471b36f8b24519a162d057d737488f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.337365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:22.348927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1076/2145] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:22 2022] DELETE /identity/v3/users/63471b36f8b24519a162d057d737488f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:22.351317 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:22.353120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:22.356896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1070/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:22 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:22.449670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:22.451433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:22.452492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996adfe-fca1-4241-a4aa-284d7356aba2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:22.459155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:22.460887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:22.461195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:22.461472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] PATH_INFO: `/v3/users/977f02b87d5648708faa4a5fac519836` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:22.463175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977f02b87d5648708faa4a5fac519836)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:22.465203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:22.468030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114a419-260b-4d03-ba81-5eacb03252f6 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:22.529179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977f02b87d5648708faa4a5fac519836'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.529901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977f02b87d5648708faa4a5fac519836'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.531465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:22.532183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:22.532663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:22.532936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:22.535509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:22.541668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977f02b87d5648708faa4a5fac519836'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.551612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977f02b87d5648708faa4a5fac519836'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.567758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977f02b87d5648708faa4a5fac519836'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:22.575192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1077/2147] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:22 2022] DELETE /identity/v3/users/977f02b87d5648708faa4a5fac519836 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:22.604102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:22.605813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:22.615757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1071/2148] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:23.017014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.018705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:23.023325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.034946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aedb08-2ddb-4ed9-94e7-cb5ffac228af service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.072538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:23.111517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a20d40-b601-4866-a99c-cc8484fe7395 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.112979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.114041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.114354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.114632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] PATH_INFO: `/v3/projects/3471326561f44d809b739bd2647b1034` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.115858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3471326561f44d809b739bd2647b1034)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.116424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.117299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.117606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.117777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.117911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] PATH_INFO: `/v3/projects/b971e2d2950645ac9168671abfc2ed62` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.119088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b971e2d2950645ac9168671abfc2ed62)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.120975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.154511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:23.168657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b971e2d2950645ac9168671abfc2ed62', 'request_id': 'req-e35f6d93-9dd9-48ec-97d0-65f27d798c77'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.170059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3471326561f44d809b739bd2647b1034', 'request_id': 'req-672c9dca-50dd-426a-a418-f8cfbdc044cc'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.175007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b971e2d2950645ac9168671abfc2ed62', 'request_id': 'req-e35f6d93-9dd9-48ec-97d0-65f27d798c77'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.175492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3471326561f44d809b739bd2647b1034', 'request_id': 'req-672c9dca-50dd-426a-a418-f8cfbdc044cc'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.181207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b971e2d2950645ac9168671abfc2ed62', 'request_id': 'req-e35f6d93-9dd9-48ec-97d0-65f27d798c77'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.181721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3471326561f44d809b739bd2647b1034', 'request_id': 'req-672c9dca-50dd-426a-a418-f8cfbdc044cc'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.196366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] The token cache is being invalidate because project 3471326561f44d809b739bd2647b1034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:23.196660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.197270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.198679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] The token cache is being invalidate because project b971e2d2950645ac9168671abfc2ed62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:23.198873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1072/2149] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:23 2022] DELETE /identity/v3/projects/3471326561f44d809b739bd2647b1034 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:23.201724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.202445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e35f6d93-9dd9-48ec-97d0-65f27d798c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.202672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.204329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:23.204463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1078/2150] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:23 2022] DELETE /identity/v3/projects/b971e2d2950645ac9168671abfc2ed62 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:23.210076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778b99-8c9f-4902-a6f9-b082553a0d27 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.211308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778b99-8c9f-4902-a6f9-b082553a0d27 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.212263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778b99-8c9f-4902-a6f9-b082553a0d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.232754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-27778b99-8c9f-4902-a6f9-b082553a0d27 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:23.234043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-27778b99-8c9f-4902-a6f9-b082553a0d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:23.271592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9dca-50dd-426a-a418-f8cfbdc044cc admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.304025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1079/2151] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:23.311637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5e07e-45d0-4ee3-80bd-61a725e4da56 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.311895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5e07e-45d0-4ee3-80bd-61a725e4da56 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.312133 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5e07e-45d0-4ee3-80bd-61a725e4da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.334045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b7c5e07e-45d0-4ee3-80bd-61a725e4da56 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:23.335318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b7c5e07e-45d0-4ee3-80bd-61a725e4da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:23.343633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1080/2152] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:23.348511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5e07e-45d0-4ee3-80bd-61a725e4da56 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.350492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.351482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.352059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.352358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] PATH_INFO: `/v3/users/a984466fda26429ebc824875eb1b3057` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.354650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a984466fda26429ebc824875eb1b3057)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.355858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.359730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5e07e-45d0-4ee3-80bd-61a725e4da56 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.365817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.366585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.366942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.367354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.368138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:23.368557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.370325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.387435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1081/2153] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:13:23.388760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.400567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52a52-73d1-46de-8771-37745a49b9b6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.408261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aac97-fd0f-4738-aa35-1fd7fa709517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.409170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aac97-fd0f-4738-aa35-1fd7fa709517 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.409458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aac97-fd0f-4738-aa35-1fd7fa709517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.409736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aac97-fd0f-4738-aa35-1fd7fa709517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.410492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aac97-fd0f-4738-aa35-1fd7fa709517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.413695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aac97-fd0f-4738-aa35-1fd7fa709517 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.426984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a984466fda26429ebc824875eb1b3057'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.437127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a984466fda26429ebc824875eb1b3057'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.444010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1082/2154] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:23 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:23.445371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c84a8f-ade5-4cae-a02c-7b34c3d0917f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.445663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c84a8f-ade5-4cae-a02c-7b34c3d0917f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.446001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c84a8f-ade5-4cae-a02c-7b34c3d0917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.451858 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:23.453204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a984466fda26429ebc824875eb1b3057'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.462695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-53c84a8f-ade5-4cae-a02c-7b34c3d0917f None None] MFA Rules not processed for user `89d1af25b199404b9f432b21c825b447`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:23.462915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a984466fda26429ebc824875eb1b3057'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.463952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a984466fda26429ebc824875eb1b3057'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:23.468406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-53c84a8f-ade5-4cae-a02c-7b34c3d0917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:23.470893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1073/2155] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:23 2022] DELETE /identity/v3/users/a984466fda26429ebc824875eb1b3057 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:23.472493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.473884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:23.489045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:23.538200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1083/2156] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:23.571297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdba34-da8b-4591-bccc-a147b998d7aa admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.576968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb888f8-3a5d-4184-820a-9af194ec6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.577785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb888f8-3a5d-4184-820a-9af194ec6504 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.578197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb888f8-3a5d-4184-820a-9af194ec6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.578570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb888f8-3a5d-4184-820a-9af194ec6504 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.579405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb888f8-3a5d-4184-820a-9af194ec6504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.583045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb888f8-3a5d-4184-820a-9af194ec6504 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.620561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1074/2157] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:23 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:23.622005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c84a8f-ade5-4cae-a02c-7b34c3d0917f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.633648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c84a8f-ade5-4cae-a02c-7b34c3d0917f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.638819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72645718-34b8-4370-b9df-254432391924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.639881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72645718-34b8-4370-b9df-254432391924 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.639881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72645718-34b8-4370-b9df-254432391924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.640182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72645718-34b8-4370-b9df-254432391924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.640829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72645718-34b8-4370-b9df-254432391924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.648704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72645718-34b8-4370-b9df-254432391924 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.660146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1084/2158] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:23.664212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb888f8-3a5d-4184-820a-9af194ec6504 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.678974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb888f8-3a5d-4184-820a-9af194ec6504 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.699827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9161c-f076-4695-848d-30df10858af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.700717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9161c-f076-4695-848d-30df10858af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.701073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9161c-f076-4695-848d-30df10858af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.701370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9161c-f076-4695-848d-30df10858af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.705276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9161c-f076-4695-848d-30df10858af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.708237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9161c-f076-4695-848d-30df10858af7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.725845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1075/2159] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:23.728336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72645718-34b8-4370-b9df-254432391924 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.742315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72645718-34b8-4370-b9df-254432391924 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:23.747374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee71f8-bd29-4b6c-9cd1-266dfc7554cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:23.748624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee71f8-bd29-4b6c-9cd1-266dfc7554cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.748986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee71f8-bd29-4b6c-9cd1-266dfc7554cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.749338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee71f8-bd29-4b6c-9cd1-266dfc7554cd admin admin] PATH_INFO: `/v3/projects/ba4bac022d174793bd4ba724ce6c1773/users/579a6c0c3e1342a3b57dcf94824edd55/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.787384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee71f8-bd29-4b6c-9cd1-266dfc7554cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4bac022d174793bd4ba724ce6c1773, user_id=579a6c0c3e1342a3b57dcf94824edd55, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:23.787384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee71f8-bd29-4b6c-9cd1-266dfc7554cd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:23.806265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1085/2160] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:23 2022] PUT /identity/v3/projects/ba4bac022d174793bd4ba724ce6c1773/users/579a6c0c3e1342a3b57dcf94824edd55/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:23.819482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed519-6414-4041-b4a7-1f27bf08806d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:23.819790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed519-6414-4041-b4a7-1f27bf08806d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:23.819990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed519-6414-4041-b4a7-1f27bf08806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:23.852558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-adaed519-6414-4041-b4a7-1f27bf08806d None None] MFA Rules not processed for user `579a6c0c3e1342a3b57dcf94824edd55`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:23.854013 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-adaed519-6414-4041-b4a7-1f27bf08806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:23.954047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1076/2161] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:23.959023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee71f8-bd29-4b6c-9cd1-266dfc7554cd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.965186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed519-6414-4041-b4a7-1f27bf08806d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:23.966831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-adaed519-6414-4041-b4a7-1f27bf08806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:24.059847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:24.067664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee71f8-bd29-4b6c-9cd1-266dfc7554cd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.071309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed519-6414-4041-b4a7-1f27bf08806d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.074486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd182c7-70b1-4f14-a960-79a11a814f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.075162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd182c7-70b1-4f14-a960-79a11a814f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.075444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd182c7-70b1-4f14-a960-79a11a814f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.075768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd182c7-70b1-4f14-a960-79a11a814f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.077306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd182c7-70b1-4f14-a960-79a11a814f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.082076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.082282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd182c7-70b1-4f14-a960-79a11a814f21 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.082364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.082364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.082364 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] PATH_INFO: `/v3/projects/49eb21b29f3e4ffeb0595869ffcd24ff` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.086417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49eb21b29f3e4ffeb0595869ffcd24ff)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.088568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.121028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1086/2162] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:23 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:24.122477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd182c7-70b1-4f14-a960-79a11a814f21 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.154117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49eb21b29f3e4ffeb0595869ffcd24ff', 'request_id': 'req-825ee501-1d6b-4429-8dfb-0018022bd544'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:24.163711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49eb21b29f3e4ffeb0595869ffcd24ff', 'request_id': 'req-825ee501-1d6b-4429-8dfb-0018022bd544'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:24.177308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49eb21b29f3e4ffeb0595869ffcd24ff', 'request_id': 'req-825ee501-1d6b-4429-8dfb-0018022bd544'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:24.195863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] The token cache is being invalidate because project 49eb21b29f3e4ffeb0595869ffcd24ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:24.196220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:24.196834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-825ee501-1d6b-4429-8dfb-0018022bd544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:24.199009 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1077/2163] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:23 2022] DELETE /identity/v3/projects/49eb21b29f3e4ffeb0595869ffcd24ff => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:24.203958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7bbe-b99a-4f86-acdc-219730005e2c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.204347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7bbe-b99a-4f86-acdc-219730005e2c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.204586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b7bbe-b99a-4f86-acdc-219730005e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.228324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-bb3b7bbe-b99a-4f86-acdc-219730005e2c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:24.229785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bb3b7bbe-b99a-4f86-acdc-219730005e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:24.236025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd182c7-70b1-4f14-a960-79a11a814f21 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.253996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:24.332761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1078/2164] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:24.351411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01162d0-6fd7-4409-b70d-c2e0f1e3db8e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.351701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01162d0-6fd7-4409-b70d-c2e0f1e3db8e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.352293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01162d0-6fd7-4409-b70d-c2e0f1e3db8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.367433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.368269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.368900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.369687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.370512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.373372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.385745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e01162d0-6fd7-4409-b70d-c2e0f1e3db8e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:24.387019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e01162d0-6fd7-4409-b70d-c2e0f1e3db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:24.409625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1079/2165] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:24.411025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01162d0-6fd7-4409-b70d-c2e0f1e3db8e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.420023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1087/2166] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:24 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:24.421993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.422160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01162d0-6fd7-4409-b70d-c2e0f1e3db8e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.424776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:24.436449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.437180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.437468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.437746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.438985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:24.439295 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.440941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.449315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1ee64-2c4f-408e-8334-17999088a9e2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.454831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1080/2167] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:13:24.459554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.459941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2d8cd-17e1-4fe9-9c84-4632f14176a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.460702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d8cd-17e1-4fe9-9c84-4632f14176a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.460949 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d8cd-17e1-4fe9-9c84-4632f14176a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.461223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d8cd-17e1-4fe9-9c84-4632f14176a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.462077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2d8cd-17e1-4fe9-9c84-4632f14176a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.463832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2d8cd-17e1-4fe9-9c84-4632f14176a7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.484902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1088/2168] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:24.485071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bb43d-a211-4b1a-b6fc-66be9240abd7 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.490907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2d8cd-17e1-4fe9-9c84-4632f14176a7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.491289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27ceb2-3c9f-497a-9d9b-1d70d1b16fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.492133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27ceb2-3c9f-497a-9d9b-1d70d1b16fac admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.492599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27ceb2-3c9f-497a-9d9b-1d70d1b16fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.492879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27ceb2-3c9f-497a-9d9b-1d70d1b16fac admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.493579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27ceb2-3c9f-497a-9d9b-1d70d1b16fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.495713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27ceb2-3c9f-497a-9d9b-1d70d1b16fac admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.505521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2d8cd-17e1-4fe9-9c84-4632f14176a7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.515516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92bedb-a26f-4470-92ff-c8841ab94678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.516468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92bedb-a26f-4470-92ff-c8841ab94678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.516741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92bedb-a26f-4470-92ff-c8841ab94678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.517074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92bedb-a26f-4470-92ff-c8841ab94678 admin admin] PATH_INFO: `/v3/projects/998576c07b584128ad037309fa744ef5/users/140beb4488b141bd96a1a7294a04fb3a/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.537867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1081/2169] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:24 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:24.542566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27ceb2-3c9f-497a-9d9b-1d70d1b16fac admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.546115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92bedb-a26f-4470-92ff-c8841ab94678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998576c07b584128ad037309fa744ef5, user_id=140beb4488b141bd96a1a7294a04fb3a, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.549925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92bedb-a26f-4470-92ff-c8841ab94678 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.569392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1089/2170] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:24 2022] PUT /identity/v3/projects/998576c07b584128ad037309fa744ef5/users/140beb4488b141bd96a1a7294a04fb3a/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:24.573376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92bedb-a26f-4470-92ff-c8841ab94678 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.602162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:24.626320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27ceb2-3c9f-497a-9d9b-1d70d1b16fac admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.647805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92bedb-a26f-4470-92ff-c8841ab94678 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.654604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4121c17-32c1-4d4d-b3bd-555096250aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.655273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121c17-32c1-4d4d-b3bd-555096250aab admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.655627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121c17-32c1-4d4d-b3bd-555096250aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.656055 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4121c17-32c1-4d4d-b3bd-555096250aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.658263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4121c17-32c1-4d4d-b3bd-555096250aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.660300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4121c17-32c1-4d4d-b3bd-555096250aab admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.673442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1090/2171] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:24.677871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4121c17-32c1-4d4d-b3bd-555096250aab admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.688695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4121c17-32c1-4d4d-b3bd-555096250aab admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.693608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5bf6f-dd34-42d6-aeb1-bc6665651d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.694544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bf6f-dd34-42d6-aeb1-bc6665651d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.694904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bf6f-dd34-42d6-aeb1-bc6665651d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.695177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bf6f-dd34-42d6-aeb1-bc6665651d55 admin admin] PATH_INFO: `/v3/projects/998576c07b584128ad037309fa744ef5/users/140beb4488b141bd96a1a7294a04fb3a/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.697416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5bf6f-dd34-42d6-aeb1-bc6665651d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998576c07b584128ad037309fa744ef5, user_id=140beb4488b141bd96a1a7294a04fb3a, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.700431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5bf6f-dd34-42d6-aeb1-bc6665651d55 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.717840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1091/2172] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:24 2022] PUT /identity/v3/projects/998576c07b584128ad037309fa744ef5/users/140beb4488b141bd96a1a7294a04fb3a/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:24.718649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c776b-d9eb-46bc-bee9-bd0c22320aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.719543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c776b-d9eb-46bc-bee9-bd0c22320aea admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.719959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c776b-d9eb-46bc-bee9-bd0c22320aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.720446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c776b-d9eb-46bc-bee9-bd0c22320aea admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.721150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c776b-d9eb-46bc-bee9-bd0c22320aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.723432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c776b-d9eb-46bc-bee9-bd0c22320aea admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.725820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c0858-7e3e-4efe-9302-518c4d2cc262 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.726137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c0858-7e3e-4efe-9302-518c4d2cc262 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.726418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c0858-7e3e-4efe-9302-518c4d2cc262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.751277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1082/2173] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:24 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:24.752341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c776b-d9eb-46bc-bee9-bd0c22320aea admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.762144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4f0c0858-7e3e-4efe-9302-518c4d2cc262 None None] MFA Rules not processed for user `140beb4488b141bd96a1a7294a04fb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:24.763542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4f0c0858-7e3e-4efe-9302-518c4d2cc262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:24.771946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c776b-d9eb-46bc-bee9-bd0c22320aea admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.819111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:24.868083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1092/2174] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:24.871001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78747c-0733-40ea-9ad6-3e093c89c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.874831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78747c-0733-40ea-9ad6-3e093c89c5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.875883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78747c-0733-40ea-9ad6-3e093c89c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.876370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78747c-0733-40ea-9ad6-3e093c89c5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.879045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78747c-0733-40ea-9ad6-3e093c89c5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.883547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78747c-0733-40ea-9ad6-3e093c89c5fd admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.884123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c0858-7e3e-4efe-9302-518c4d2cc262 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.885755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4f0c0858-7e3e-4efe-9302-518c4d2cc262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:24.908534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1083/2175] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:24.910538 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78747c-0733-40ea-9ad6-3e093c89c5fd admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.924638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78747c-0733-40ea-9ad6-3e093c89c5fd admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.930733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b358ff-e908-4e58-a871-943cc69f5d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.931411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b358ff-e908-4e58-a871-943cc69f5d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.931792 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b358ff-e908-4e58-a871-943cc69f5d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.932064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b358ff-e908-4e58-a871-943cc69f5d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.933142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b358ff-e908-4e58-a871-943cc69f5d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.935148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b358ff-e908-4e58-a871-943cc69f5d89 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.948301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1084/2176] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:24.952323 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b358ff-e908-4e58-a871-943cc69f5d89 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:24.965607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b358ff-e908-4e58-a871-943cc69f5d89 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.972282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232cd91-4121-49c3-8298-689bd182d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.973578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232cd91-4121-49c3-8298-689bd182d18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.973896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232cd91-4121-49c3-8298-689bd182d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.974349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232cd91-4121-49c3-8298-689bd182d18e admin admin] PATH_INFO: `/v3/projects/9c8be53330104b5091ffefd2cf95ee81/users/fdc4a8f96c3047bdaf94021e1baf1a1b/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.975755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c0858-7e3e-4efe-9302-518c4d2cc262 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:24.981488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:24.982440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:24.983608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:24.983965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:24.994720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.996843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:24.997057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232cd91-4121-49c3-8298-689bd182d18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8be53330104b5091ffefd2cf95ee81, user_id=fdc4a8f96c3047bdaf94021e1baf1a1b, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:24.999936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232cd91-4121-49c3-8298-689bd182d18e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:25.014883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1085/2177] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:24 2022] PUT /identity/v3/projects/9c8be53330104b5091ffefd2cf95ee81/users/fdc4a8f96c3047bdaf94021e1baf1a1b/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:25.015372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1093/2178] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:25.093620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021939ad-0b81-4468-9cb5-91ccb2f276f0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:25.094188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021939ad-0b81-4468-9cb5-91ccb2f276f0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:25.094395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021939ad-0b81-4468-9cb5-91ccb2f276f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:25.132306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-021939ad-0b81-4468-9cb5-91ccb2f276f0 None None] MFA Rules not processed for user `fdc4a8f96c3047bdaf94021e1baf1a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:25.133380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-021939ad-0b81-4468-9cb5-91ccb2f276f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:25.174387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:25.213990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1086/2179] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:25.225763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:25.227223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:25.291647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304b7ca-b2b1-4fa5-81ea-77055e27a1ab service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:25.345831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e3bf3-025b-4b4f-86a4-a56391e489cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c211cd37d7f49eaa916d332580135c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:25.345831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e3bf3-025b-4b4f-86a4-a56391e489cc service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:25.345831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e3bf3-025b-4b4f-86a4-a56391e489cc service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:25.346187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e3bf3-025b-4b4f-86a4-a56391e489cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:25.355540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e3bf3-025b-4b4f-86a4-a56391e489cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:25.357923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e3bf3-025b-4b4f-86a4-a56391e489cc service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:25.369844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1094/2180] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:25.431765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021939ad-0b81-4468-9cb5-91ccb2f276f0 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:25.507121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021939ad-0b81-4468-9cb5-91ccb2f276f0 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:25.512910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:25.513833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:25.514118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:25.514398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] PATH_INFO: `/v3/users/579a6c0c3e1342a3b57dcf94824edd55` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:25.515598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579a6c0c3e1342a3b57dcf94824edd55)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:25.517536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:25.596876 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579a6c0c3e1342a3b57dcf94824edd55'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.606418 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579a6c0c3e1342a3b57dcf94824edd55'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.624868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579a6c0c3e1342a3b57dcf94824edd55'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.632454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579a6c0c3e1342a3b57dcf94824edd55'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.633285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579a6c0c3e1342a3b57dcf94824edd55'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.639915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1087/2181] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:25 2022] DELETE /identity/v3/users/579a6c0c3e1342a3b57dcf94824edd55 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:25.645131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c1ce-8bc2-4ec4-ba6e-64b0091f2da5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:25.645423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c1ce-8bc2-4ec4-ba6e-64b0091f2da5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:25.646015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c1ce-8bc2-4ec4-ba6e-64b0091f2da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:25.665329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d547c1ce-8bc2-4ec4-ba6e-64b0091f2da5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:25.666673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d547c1ce-8bc2-4ec4-ba6e-64b0091f2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:25.672426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:25.674098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:25.716591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:25.740109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1095/2182] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:25.751526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c1ce-8bc2-4ec4-ba6e-64b0091f2da5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:25.754105 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:25.754347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d547c1ce-8bc2-4ec4-ba6e-64b0091f2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:25.777222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9778703-35aa-49c7-820f-383a14a0ab99 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:25.788721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:25.789750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:25.790375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:25.790750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] PATH_INFO: `/v3/users/cbf627bb5d3d40539fa93f504856aac7` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:25.792092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf627bb5d3d40539fa93f504856aac7)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:25.794190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:25.840194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c1ce-8bc2-4ec4-ba6e-64b0091f2da5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:25.845522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adba022-271d-476f-a15f-02bf268341ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:25.846924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba022-271d-476f-a15f-02bf268341ec service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:25.847288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba022-271d-476f-a15f-02bf268341ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:25.847659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba022-271d-476f-a15f-02bf268341ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:25.870883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adba022-271d-476f-a15f-02bf268341ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:25.872607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adba022-271d-476f-a15f-02bf268341ec service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:25.879247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf627bb5d3d40539fa93f504856aac7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.890751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf627bb5d3d40539fa93f504856aac7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.910088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1096/2183] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:25.928567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf627bb5d3d40539fa93f504856aac7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.938847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf627bb5d3d40539fa93f504856aac7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.939616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf627bb5d3d40539fa93f504856aac7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:25.948981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1088/2184] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:25 2022] DELETE /identity/v3/users/cbf627bb5d3d40539fa93f504856aac7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:25.953637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400c51-a5a8-4cf0-bd48-f4855eb2d268 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:25.953801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400c51-a5a8-4cf0-bd48-f4855eb2d268 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:25.954107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400c51-a5a8-4cf0-bd48-f4855eb2d268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:25.978067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-56400c51-a5a8-4cf0-bd48-f4855eb2d268 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:25.979471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-56400c51-a5a8-4cf0-bd48-f4855eb2d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:26.060151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1097/2185] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:26.070486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:26.071972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:26.145526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665c724-c021-465f-81b9-df16829f4e45 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:26.149742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d756fd-d0b0-4016-b737-ea1a1dc69403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:26.150624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d756fd-d0b0-4016-b737-ea1a1dc69403 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:26.150961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d756fd-d0b0-4016-b737-ea1a1dc69403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:26.151423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d756fd-d0b0-4016-b737-ea1a1dc69403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:26.162189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d756fd-d0b0-4016-b737-ea1a1dc69403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:26.163656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d756fd-d0b0-4016-b737-ea1a1dc69403 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:26.175296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1089/2186] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:26.276255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56400c51-a5a8-4cf0-bd48-f4855eb2d268 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:26.278031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-56400c51-a5a8-4cf0-bd48-f4855eb2d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:26.292822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56400c51-a5a8-4cf0-bd48-f4855eb2d268 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:26.299923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:26.300951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:26.301492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:26.301945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] PATH_INFO: `/v3/projects/ba4bac022d174793bd4ba724ce6c1773` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:26.303798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4bac022d174793bd4ba724ce6c1773)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:26.305909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:26.363171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4bac022d174793bd4ba724ce6c1773', 'request_id': 'req-d42c2049-f1b5-4524-ac4f-369614277c56'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.368639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4bac022d174793bd4ba724ce6c1773', 'request_id': 'req-d42c2049-f1b5-4524-ac4f-369614277c56'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.375300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4bac022d174793bd4ba724ce6c1773', 'request_id': 'req-d42c2049-f1b5-4524-ac4f-369614277c56'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.391481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] The token cache is being invalidate because project ba4bac022d174793bd4ba724ce6c1773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:26.391709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.392349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.394022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1098/2187] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:26 2022] DELETE /identity/v3/projects/ba4bac022d174793bd4ba724ce6c1773 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:26.398389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d756fd-d0b0-4016-b737-ea1a1dc69403 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:26.412116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d756fd-d0b0-4016-b737-ea1a1dc69403 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:26.475621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:26.476552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:26.476836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:26.477091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] PATH_INFO: `/v3/users/140beb4488b141bd96a1a7294a04fb3a` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:26.478417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] RBAC: Authorizing `identity:delete_user(user_id=140beb4488b141bd96a1a7294a04fb3a)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:26.480411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:26.504403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:26.528968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:26.531367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:26.579684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140beb4488b141bd96a1a7294a04fb3a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.587207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c2049-f1b5-4524-ac4f-369614277c56 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:26.590566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140beb4488b141bd96a1a7294a04fb3a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.595843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:26.596940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:26.597259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:26.597540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] PATH_INFO: `/v3/projects/09b53232fd0245278ef9f7befc66e509` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:26.598843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b53232fd0245278ef9f7befc66e509)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:26.600909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:26.603814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:26.607069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140beb4488b141bd96a1a7294a04fb3a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.617652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140beb4488b141bd96a1a7294a04fb3a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.618545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140beb4488b141bd96a1a7294a04fb3a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.625479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1090/2188] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:26 2022] DELETE /identity/v3/users/140beb4488b141bd96a1a7294a04fb3a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:26.661175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b53232fd0245278ef9f7befc66e509', 'request_id': 'req-64a80a31-b904-4aeb-aa63-36c896824a37'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.667554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b53232fd0245278ef9f7befc66e509', 'request_id': 'req-64a80a31-b904-4aeb-aa63-36c896824a37'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.674702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b53232fd0245278ef9f7befc66e509', 'request_id': 'req-64a80a31-b904-4aeb-aa63-36c896824a37'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.692800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] The token cache is being invalidate because project 09b53232fd0245278ef9f7befc66e509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:26.693106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.693864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.695743 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1099/2189] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:26 2022] DELETE /identity/v3/projects/09b53232fd0245278ef9f7befc66e509 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:26.699724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:26.701547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:26.778822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211bcf7-64da-4832-b512-dee7dd56832f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:26.843066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:26.843960 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:26.844237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:26.844506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] PATH_INFO: `/v3/users/f8a120d05a2240df9d6814cb29d75d93` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:26.845705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a120d05a2240df9d6814cb29d75d93)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:26.848024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:26.893847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:26.899851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a120d05a2240df9d6814cb29d75d93'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.910053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a120d05a2240df9d6814cb29d75d93'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.925753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a120d05a2240df9d6814cb29d75d93'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.934859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a120d05a2240df9d6814cb29d75d93'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.935611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a120d05a2240df9d6814cb29d75d93'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:26.943661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1091/2190] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:26 2022] DELETE /identity/v3/users/f8a120d05a2240df9d6814cb29d75d93 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:27.140586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.142600 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:27.158278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a80a31-b904-4aeb-aa63-36c896824a37 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.225029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.226058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.226412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.228736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] PATH_INFO: `/v3/projects/998576c07b584128ad037309fa744ef5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.230712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998576c07b584128ad037309fa744ef5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.233020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.279579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.281513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:27.306647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998576c07b584128ad037309fa744ef5', 'request_id': 'req-d898203c-022d-42ba-8063-b4a10fd33680'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.312343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1186-d19f-44a0-86d2-3c2ad67704c9 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.331307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998576c07b584128ad037309fa744ef5', 'request_id': 'req-d898203c-022d-42ba-8063-b4a10fd33680'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.345603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998576c07b584128ad037309fa744ef5', 'request_id': 'req-d898203c-022d-42ba-8063-b4a10fd33680'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.374557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] The token cache is being invalidate because project 998576c07b584128ad037309fa744ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:27.374927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.375824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d898203c-022d-42ba-8063-b4a10fd33680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.377722 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1100/2191] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:27 2022] DELETE /identity/v3/projects/998576c07b584128ad037309fa744ef5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:27.385537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc325a-9202-4ef0-8ca1-aa6f2971db5f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.385859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc325a-9202-4ef0-8ca1-aa6f2971db5f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.386439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc325a-9202-4ef0-8ca1-aa6f2971db5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.417575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.419417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.419916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.420365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] PATH_INFO: `/v3/projects/6b8d24e6e02042e5bd37a17f4bc35b0f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.421823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8d24e6e02042e5bd37a17f4bc35b0f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.423925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.431635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-92cc325a-9202-4ef0-8ca1-aa6f2971db5f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:27.435004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-92cc325a-9202-4ef0-8ca1-aa6f2971db5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:27.475255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1101/2192] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:27.483415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1aeb-abe9-413e-bde1-16a37ccc4f17 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.483699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1aeb-abe9-413e-bde1-16a37ccc4f17 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.483977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1aeb-abe9-413e-bde1-16a37ccc4f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.503175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8d24e6e02042e5bd37a17f4bc35b0f', 'request_id': 'req-f9034aad-4fb3-4150-8073-705cc4b5671b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.507342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b55d1aeb-abe9-413e-bde1-16a37ccc4f17 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:27.508874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b55d1aeb-abe9-413e-bde1-16a37ccc4f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:27.509178 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8d24e6e02042e5bd37a17f4bc35b0f', 'request_id': 'req-f9034aad-4fb3-4150-8073-705cc4b5671b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.518469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8d24e6e02042e5bd37a17f4bc35b0f', 'request_id': 'req-f9034aad-4fb3-4150-8073-705cc4b5671b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.518967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:27.539736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] The token cache is being invalidate because project 6b8d24e6e02042e5bd37a17f4bc35b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:27.540057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.540717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f9034aad-4fb3-4150-8073-705cc4b5671b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:27.542385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1092/2193] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:27 2022] DELETE /identity/v3/projects/6b8d24e6e02042e5bd37a17f4bc35b0f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:27.547205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c2275-7f95-459a-9c78-f266949b58c5 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.547481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c2275-7f95-459a-9c78-f266949b58c5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.547753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c2275-7f95-459a-9c78-f266949b58c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.566658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-7b7c2275-7f95-459a-9c78-f266949b58c5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:27.567884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-7b7c2275-7f95-459a-9c78-f266949b58c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:27.580176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1102/2194] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:27.586416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1aeb-abe9-413e-bde1-16a37ccc4f17 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.602057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d1aeb-abe9-413e-bde1-16a37ccc4f17 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.610835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.611700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.614779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.614779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.614779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:27.614779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.617894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.630503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:27.639759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1103/2195] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:13:27.644344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.655603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61c41-642a-49c5-bc66-5e2e5c2c59b2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.660680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64933fdf-739a-414e-b335-764ad0870e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.661355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933fdf-739a-414e-b335-764ad0870e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.661632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933fdf-739a-414e-b335-764ad0870e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.661911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933fdf-739a-414e-b335-764ad0870e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.662642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64933fdf-739a-414e-b335-764ad0870e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.664310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1093/2196] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:27.665418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64933fdf-739a-414e-b335-764ad0870e55 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.665681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c809422-5c55-4da8-aaff-2dcb65412abd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.666085 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c809422-5c55-4da8-aaff-2dcb65412abd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.666283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c809422-5c55-4da8-aaff-2dcb65412abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.691938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-8c809422-5c55-4da8-aaff-2dcb65412abd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:27.692850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8c809422-5c55-4da8-aaff-2dcb65412abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:27.706164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1104/2197] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:27 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:27.706258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1094/2198] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:27.707022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64933fdf-739a-414e-b335-764ad0870e55 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.709607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c809422-5c55-4da8-aaff-2dcb65412abd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.719106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c809422-5c55-4da8-aaff-2dcb65412abd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.772912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64933fdf-739a-414e-b335-764ad0870e55 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.777703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e59c-3516-46a8-8413-7ee80866f7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.778447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e59c-3516-46a8-8413-7ee80866f7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.778733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e59c-3516-46a8-8413-7ee80866f7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.779038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792e59c-3516-46a8-8413-7ee80866f7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.779339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.779744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792e59c-3516-46a8-8413-7ee80866f7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.780041 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.780377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.780724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.781628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:27.781776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792e59c-3516-46a8-8413-7ee80866f7e2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.781969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.785019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.803895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1095/2199] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:13:27.807819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1105/2200] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:27 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:27.807947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.808970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e59c-3516-46a8-8413-7ee80866f7e2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.815967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1a9a2-4b72-4c77-92d6-c89a41d3fc95 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.819013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792e59c-3516-46a8-8413-7ee80866f7e2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.821667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f6ce-96d6-4f06-ab88-426c50f5cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.822388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f6ce-96d6-4f06-ab88-426c50f5cf11 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.822730 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f6ce-96d6-4f06-ab88-426c50f5cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.823048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646f6ce-96d6-4f06-ab88-426c50f5cf11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.823830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b243cec-9b87-4e98-a642-cea15785e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.823978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646f6ce-96d6-4f06-ab88-426c50f5cf11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.824482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b243cec-9b87-4e98-a642-cea15785e4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.824762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b243cec-9b87-4e98-a642-cea15785e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.825031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b243cec-9b87-4e98-a642-cea15785e4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.825752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b243cec-9b87-4e98-a642-cea15785e4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.825923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646f6ce-96d6-4f06-ab88-426c50f5cf11 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.827356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b243cec-9b87-4e98-a642-cea15785e4fb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.837497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1106/2201] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:27.841607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b243cec-9b87-4e98-a642-cea15785e4fb admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.851983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b243cec-9b87-4e98-a642-cea15785e4fb admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.857066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302679d-45a9-4472-9bf3-c760df915151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.857742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302679d-45a9-4472-9bf3-c760df915151 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.858051 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302679d-45a9-4472-9bf3-c760df915151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.858330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302679d-45a9-4472-9bf3-c760df915151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.858540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1096/2202] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:27 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:27.859049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302679d-45a9-4472-9bf3-c760df915151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.861497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302679d-45a9-4472-9bf3-c760df915151 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.862590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f6ce-96d6-4f06-ab88-426c50f5cf11 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.873962 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1107/2203] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:27.878310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302679d-45a9-4472-9bf3-c760df915151 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:27.890593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302679d-45a9-4472-9bf3-c760df915151 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.946183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646f6ce-96d6-4f06-ab88-426c50f5cf11 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:27.949087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:27.951520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f279b8-c6df-4832-8f5a-4b532a84c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.954137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f279b8-c6df-4832-8f5a-4b532a84c05f admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.954137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f279b8-c6df-4832-8f5a-4b532a84c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.954316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f279b8-c6df-4832-8f5a-4b532a84c05f admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.955140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f279b8-c6df-4832-8f5a-4b532a84c05f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:27.958861 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f279b8-c6df-4832-8f5a-4b532a84c05f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:27.990120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1097/2204] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:27 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:27.990574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7966407-afd1-45fa-aff9-e848f1f90856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:27.991487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966407-afd1-45fa-aff9-e848f1f90856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:27.991774 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966407-afd1-45fa-aff9-e848f1f90856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:27.992040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7966407-afd1-45fa-aff9-e848f1f90856 admin admin] PATH_INFO: `/v3/projects/ed616463f0f94e55bdb5b620462434f4/users/fddd91d0876940faba524126a1ea258c/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:27.994101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f279b8-c6df-4832-8f5a-4b532a84c05f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.005075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f279b8-c6df-4832-8f5a-4b532a84c05f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.009865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3166-384e-42d1-87d4-be121dffd514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.010509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3166-384e-42d1-87d4-be121dffd514 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.010789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3166-384e-42d1-87d4-be121dffd514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.011133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae3166-384e-42d1-87d4-be121dffd514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.012171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae3166-384e-42d1-87d4-be121dffd514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.013617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae3166-384e-42d1-87d4-be121dffd514 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.023269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7966407-afd1-45fa-aff9-e848f1f90856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed616463f0f94e55bdb5b620462434f4, user_id=fddd91d0876940faba524126a1ea258c, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.025645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1098/2205] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:28.026592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7966407-afd1-45fa-aff9-e848f1f90856 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.030369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3166-384e-42d1-87d4-be121dffd514 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.041931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae3166-384e-42d1-87d4-be121dffd514 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.048035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa697b-28af-4cc7-9d0f-158b03e93c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.049307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa697b-28af-4cc7-9d0f-158b03e93c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.050277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa697b-28af-4cc7-9d0f-158b03e93c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.051127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa697b-28af-4cc7-9d0f-158b03e93c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.052434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa697b-28af-4cc7-9d0f-158b03e93c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.054811 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa697b-28af-4cc7-9d0f-158b03e93c95 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.062631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1108/2206] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:27 2022] PUT /identity/v3/projects/ed616463f0f94e55bdb5b620462434f4/users/fddd91d0876940faba524126a1ea258c/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:28.072402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1099/2207] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:28.077542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3179470-44e4-4ce7-a4c8-4a4e2eae25e4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.077954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3179470-44e4-4ce7-a4c8-4a4e2eae25e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.078407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3179470-44e4-4ce7-a4c8-4a4e2eae25e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.084431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa697b-28af-4cc7-9d0f-158b03e93c95 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.104302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa697b-28af-4cc7-9d0f-158b03e93c95 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.117256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c3179470-44e4-4ce7-a4c8-4a4e2eae25e4 None None] MFA Rules not processed for user `fddd91d0876940faba524126a1ea258c`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:28.118770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c3179470-44e4-4ce7-a4c8-4a4e2eae25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:28.128378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:28.189933 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debc01b-e808-4805-b9e4-2f3dfd831e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.190836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debc01b-e808-4805-b9e4-2f3dfd831e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.191215 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debc01b-e808-4805-b9e4-2f3dfd831e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.191541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debc01b-e808-4805-b9e4-2f3dfd831e2d admin admin] PATH_INFO: `/v3/projects/f2745e356488482d8279db6b03db6668/users/779cd54370064ebea50c70e1a122cb8c/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.204663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1109/2208] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:28.208913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3179470-44e4-4ce7-a4c8-4a4e2eae25e4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.211409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debc01b-e808-4805-b9e4-2f3dfd831e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2745e356488482d8279db6b03db6668, user_id=779cd54370064ebea50c70e1a122cb8c, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.214144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debc01b-e808-4805-b9e4-2f3dfd831e2d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.220666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3179470-44e4-4ce7-a4c8-4a4e2eae25e4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.226536 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4117-0b8d-432e-b75a-81ee3ddd141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.227295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4117-0b8d-432e-b75a-81ee3ddd141e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.227664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4117-0b8d-432e-b75a-81ee3ddd141e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.228871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4117-0b8d-432e-b75a-81ee3ddd141e admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.228871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f4117-0b8d-432e-b75a-81ee3ddd141e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.230762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f4117-0b8d-432e-b75a-81ee3ddd141e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.231974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1100/2209] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:28 2022] PUT /identity/v3/projects/f2745e356488482d8279db6b03db6668/users/779cd54370064ebea50c70e1a122cb8c/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:28.242833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233684-4a1b-4fe5-a8a3-1f89a6f76199 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.243192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233684-4a1b-4fe5-a8a3-1f89a6f76199 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.244079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8233684-4a1b-4fe5-a8a3-1f89a6f76199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.262454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1110/2210] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:28.266278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4117-0b8d-432e-b75a-81ee3ddd141e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.280037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e8233684-4a1b-4fe5-a8a3-1f89a6f76199 None None] MFA Rules not processed for user `779cd54370064ebea50c70e1a122cb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:28.281569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e8233684-4a1b-4fe5-a8a3-1f89a6f76199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:28.343074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4117-0b8d-432e-b75a-81ee3ddd141e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.348708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ba2db-1cb4-4d3b-af1d-72bc9b93e4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.349863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ba2db-1cb4-4d3b-af1d-72bc9b93e4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.350131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ba2db-1cb4-4d3b-af1d-72bc9b93e4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.350544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ba2db-1cb4-4d3b-af1d-72bc9b93e4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.351985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ba2db-1cb4-4d3b-af1d-72bc9b93e4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.354137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ba2db-1cb4-4d3b-af1d-72bc9b93e4b9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.364691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1101/2211] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:28.366042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8233684-4a1b-4fe5-a8a3-1f89a6f76199 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.378841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8233684-4a1b-4fe5-a8a3-1f89a6f76199 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.382435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1111/2212] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:28.385443 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ba2db-1cb4-4d3b-af1d-72bc9b93e4b9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.388059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1622990-9686-42e6-aa52-c0a33fec70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.388752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622990-9686-42e6-aa52-c0a33fec70a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.389036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622990-9686-42e6-aa52-c0a33fec70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.389310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622990-9686-42e6-aa52-c0a33fec70a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.390091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1622990-9686-42e6-aa52-c0a33fec70a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.391997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1622990-9686-42e6-aa52-c0a33fec70a3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.397248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ba2db-1cb4-4d3b-af1d-72bc9b93e4b9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.402986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8f71-661a-42ea-ab4d-410afff211cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.403666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8f71-661a-42ea-ab4d-410afff211cc admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.403969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8f71-661a-42ea-ab4d-410afff211cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.404231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8f71-661a-42ea-ab4d-410afff211cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.404965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8f71-661a-42ea-ab4d-410afff211cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.406620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8f71-661a-42ea-ab4d-410afff211cc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.424196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1102/2213] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:28.425516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1112/2214] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:28.428864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1622990-9686-42e6-aa52-c0a33fec70a3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.430006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8f71-661a-42ea-ab4d-410afff211cc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.441700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8f71-661a-42ea-ab4d-410afff211cc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.460206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:28.517710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1622990-9686-42e6-aa52-c0a33fec70a3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.525585 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b543e-58ae-435b-8f8d-ce1fffc92c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.526454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b543e-58ae-435b-8f8d-ce1fffc92c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.526786 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b543e-58ae-435b-8f8d-ce1fffc92c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.527210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b543e-58ae-435b-8f8d-ce1fffc92c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.528025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b543e-58ae-435b-8f8d-ce1fffc92c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.529848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e697369-6d9b-47d4-9b83-e90fcd92bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.530016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b543e-58ae-435b-8f8d-ce1fffc92c49 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.531102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697369-6d9b-47d4-9b83-e90fcd92bbba admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.531400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697369-6d9b-47d4-9b83-e90fcd92bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.531822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697369-6d9b-47d4-9b83-e90fcd92bbba admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.532645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e697369-6d9b-47d4-9b83-e90fcd92bbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.536028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e697369-6d9b-47d4-9b83-e90fcd92bbba admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.552390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1113/2215] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:28.556480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e697369-6d9b-47d4-9b83-e90fcd92bbba admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.561311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1103/2216] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/users => generated 303 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:28.567222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b543e-58ae-435b-8f8d-ce1fffc92c49 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.569583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e697369-6d9b-47d4-9b83-e90fcd92bbba admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.576985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd14074-ad46-4c81-9466-2884b701ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.577190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:28.577315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd14074-ad46-4c81-9466-2884b701ddd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.577765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd14074-ad46-4c81-9466-2884b701ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.578126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd14074-ad46-4c81-9466-2884b701ddd5 admin admin] PATH_INFO: `/v3/projects/54ec4ea8a18b465c8fe56cdf43d8d31c/users/4f4912bc1db74d4aadb359248d81a1e1/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.590621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b543e-58ae-435b-8f8d-ce1fffc92c49 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.596021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd3348-7e41-440a-9482-dec97806cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.596956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd3348-7e41-440a-9482-dec97806cb48 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.597311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd3348-7e41-440a-9482-dec97806cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.597727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd3348-7e41-440a-9482-dec97806cb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.598686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd3348-7e41-440a-9482-dec97806cb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.600724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd3348-7e41-440a-9482-dec97806cb48 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.600847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd14074-ad46-4c81-9466-2884b701ddd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec4ea8a18b465c8fe56cdf43d8d31c, user_id=4f4912bc1db74d4aadb359248d81a1e1, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.603880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd14074-ad46-4c81-9466-2884b701ddd5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.613824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1104/2217] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:28.618057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd3348-7e41-440a-9482-dec97806cb48 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.628161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1114/2218] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:28 2022] PUT /identity/v3/projects/54ec4ea8a18b465c8fe56cdf43d8d31c/users/4f4912bc1db74d4aadb359248d81a1e1/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:28.628387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd3348-7e41-440a-9482-dec97806cb48 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.638393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21efab4-c907-46fe-b04f-91f1d9be70cc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.638796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21efab4-c907-46fe-b04f-91f1d9be70cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.638978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21efab4-c907-46fe-b04f-91f1d9be70cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.683243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c21efab4-c907-46fe-b04f-91f1d9be70cc None None] MFA Rules not processed for user `4f4912bc1db74d4aadb359248d81a1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:28.685046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c21efab4-c907-46fe-b04f-91f1d9be70cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:28.711232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b55619-d1c6-4701-870b-7ef6f9af5abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.712340 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55619-d1c6-4701-870b-7ef6f9af5abf admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.712682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55619-d1c6-4701-870b-7ef6f9af5abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.713017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55619-d1c6-4701-870b-7ef6f9af5abf admin admin] PATH_INFO: `/v3/projects/b4b12b2b15694a3f98c2895a3660a94d/users/6cba5413f1344c759517e76043d6e6e2/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.731770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b55619-d1c6-4701-870b-7ef6f9af5abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b12b2b15694a3f98c2895a3660a94d, user_id=6cba5413f1344c759517e76043d6e6e2, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.739209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b55619-d1c6-4701-870b-7ef6f9af5abf admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.764415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1105/2219] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:28 2022] PUT /identity/v3/projects/b4b12b2b15694a3f98c2895a3660a94d/users/6cba5413f1344c759517e76043d6e6e2/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:28.773474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b55619-d1c6-4701-870b-7ef6f9af5abf admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.810961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1115/2220] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:28.816571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21efab4-c907-46fe-b04f-91f1d9be70cc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.833187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21efab4-c907-46fe-b04f-91f1d9be70cc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.890568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b55619-d1c6-4701-870b-7ef6f9af5abf admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.896611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694a956-bc83-42e8-8a8b-af3bea47da22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.897443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694a956-bc83-42e8-8a8b-af3bea47da22 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.897731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694a956-bc83-42e8-8a8b-af3bea47da22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.898039 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694a956-bc83-42e8-8a8b-af3bea47da22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.898924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694a956-bc83-42e8-8a8b-af3bea47da22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.900749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694a956-bc83-42e8-8a8b-af3bea47da22 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.911915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1106/2221] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:28.916770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694a956-bc83-42e8-8a8b-af3bea47da22 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.920809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e038de0-7ac3-4bdf-bf39-4852ba31f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.921497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038de0-7ac3-4bdf-bf39-4852ba31f5cc admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.921784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038de0-7ac3-4bdf-bf39-4852ba31f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.922080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e038de0-7ac3-4bdf-bf39-4852ba31f5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.922787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e038de0-7ac3-4bdf-bf39-4852ba31f5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.924934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e038de0-7ac3-4bdf-bf39-4852ba31f5cc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.958616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694a956-bc83-42e8-8a8b-af3bea47da22 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:28.967813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19f7e7-5d3a-4b71-8f1f-152871b0719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:28.968952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f7e7-5d3a-4b71-8f1f-152871b0719e admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:28.969233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f7e7-5d3a-4b71-8f1f-152871b0719e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:28.970131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19f7e7-5d3a-4b71-8f1f-152871b0719e admin admin] PATH_INFO: `/v3/projects/b4b12b2b15694a3f98c2895a3660a94d/users/6cba5413f1344c759517e76043d6e6e2/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:28.972751 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19f7e7-5d3a-4b71-8f1f-152871b0719e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b12b2b15694a3f98c2895a3660a94d, user_id=6cba5413f1344c759517e76043d6e6e2, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:28.975563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19f7e7-5d3a-4b71-8f1f-152871b0719e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:28.977893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1116/2222] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:28.979741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e038de0-7ac3-4bdf-bf39-4852ba31f5cc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:28.985630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:28.993205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1107/2223] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:28 2022] PUT /identity/v3/projects/b4b12b2b15694a3f98c2895a3660a94d/users/6cba5413f1344c759517e76043d6e6e2/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:29.004574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37717d-3b31-438c-94c6-b9f2bd2cb1a9 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.004941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37717d-3b31-438c-94c6-b9f2bd2cb1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.005286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37717d-3b31-438c-94c6-b9f2bd2cb1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.039996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-4e37717d-3b31-438c-94c6-b9f2bd2cb1a9 None None] MFA Rules not processed for user `6cba5413f1344c759517e76043d6e6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:29.041354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4e37717d-3b31-438c-94c6-b9f2bd2cb1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:29.059807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e038de0-7ac3-4bdf-bf39-4852ba31f5cc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:29.094610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:29.135384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1108/2224] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:29.150525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37717d-3b31-438c-94c6-b9f2bd2cb1a9 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:29.152542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4e37717d-3b31-438c-94c6-b9f2bd2cb1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:29.152817 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd92ff5-f976-4b10-8920-2de1642a1995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:29.153506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd92ff5-f976-4b10-8920-2de1642a1995 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.153809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd92ff5-f976-4b10-8920-2de1642a1995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.154131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd92ff5-f976-4b10-8920-2de1642a1995 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.154872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd92ff5-f976-4b10-8920-2de1642a1995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:29.158461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd92ff5-f976-4b10-8920-2de1642a1995 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:29.191108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1117/2225] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:28 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:29.195306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd92ff5-f976-4b10-8920-2de1642a1995 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:29.226409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd92ff5-f976-4b10-8920-2de1642a1995 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:29.228486 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37717d-3b31-438c-94c6-b9f2bd2cb1a9 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:29.234694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:29.235520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.235872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.236301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.239832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f5076-96e4-43bc-8448-bed7ba416d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:29.240707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f5076-96e4-43bc-8448-bed7ba416d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.241083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f5076-96e4-43bc-8448-bed7ba416d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.241461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f5076-96e4-43bc-8448-bed7ba416d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.248275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:29.249914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:29.251129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f5076-96e4-43bc-8448-bed7ba416d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:29.253192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f5076-96e4-43bc-8448-bed7ba416d1e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:29.267395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1118/2227] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:29.271565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f5076-96e4-43bc-8448-bed7ba416d1e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:29.276479 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1109/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:29.286402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f5076-96e4-43bc-8448-bed7ba416d1e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:29.294694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da04626-69c1-4e04-91d2-d12e7d836ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:29.295616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da04626-69c1-4e04-91d2-d12e7d836ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.295899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da04626-69c1-4e04-91d2-d12e7d836ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.296178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da04626-69c1-4e04-91d2-d12e7d836ba4 admin admin] PATH_INFO: `/v3/projects/4f8270e37dfa4a29bd62e5e1c22d7605/users/b361a10f54444d169dadcb4bea6d64a1/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.317833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da04626-69c1-4e04-91d2-d12e7d836ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8270e37dfa4a29bd62e5e1c22d7605, user_id=b361a10f54444d169dadcb4bea6d64a1, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:29.321044 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da04626-69c1-4e04-91d2-d12e7d836ba4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:29.324695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:29.326232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:29.338424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b452-9d8d-4af2-94c4-97ce8d064440 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:29.343519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1119/2228] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:29 2022] PUT /identity/v3/projects/4f8270e37dfa4a29bd62e5e1c22d7605/users/b361a10f54444d169dadcb4bea6d64a1/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:29.348219 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da04626-69c1-4e04-91d2-d12e7d836ba4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:29.419249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba6550-50ba-4c7f-a0b3-085ed69aa4ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:29.419961 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6550-50ba-4c7f-a0b3-085ed69aa4ab service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.420320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6550-50ba-4c7f-a0b3-085ed69aa4ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.420553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba6550-50ba-4c7f-a0b3-085ed69aa4ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.455541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da04626-69c1-4e04-91d2-d12e7d836ba4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:29.461042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9b764-cd21-4af3-ab96-282b06c2a4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:29.461925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9b764-cd21-4af3-ab96-282b06c2a4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.462783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9b764-cd21-4af3-ab96-282b06c2a4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.463170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9b764-cd21-4af3-ab96-282b06c2a4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.464077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9b764-cd21-4af3-ab96-282b06c2a4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:29.465956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9b764-cd21-4af3-ab96-282b06c2a4fd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:29.481213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1120/2229] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:29.482461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9b764-cd21-4af3-ab96-282b06c2a4fd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:29.489093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:29.500413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9b764-cd21-4af3-ab96-282b06c2a4fd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:29.512060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533709c-fc57-45a1-af5d-be7633b820ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:29.512953 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533709c-fc57-45a1-af5d-be7633b820ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.515381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533709c-fc57-45a1-af5d-be7633b820ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.515666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533709c-fc57-45a1-af5d-be7633b820ea admin admin] PATH_INFO: `/v3/projects/4f8270e37dfa4a29bd62e5e1c22d7605/users/b361a10f54444d169dadcb4bea6d64a1/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.522559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533709c-fc57-45a1-af5d-be7633b820ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8270e37dfa4a29bd62e5e1c22d7605, user_id=b361a10f54444d169dadcb4bea6d64a1, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:29.525339 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533709c-fc57-45a1-af5d-be7633b820ea admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:29.530714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba6550-50ba-4c7f-a0b3-085ed69aa4ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:29.534955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba6550-50ba-4c7f-a0b3-085ed69aa4ab service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:29.548644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1110/2230] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:29.551754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1121/2231] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:29 2022] PUT /identity/v3/projects/4f8270e37dfa4a29bd62e5e1c22d7605/users/b361a10f54444d169dadcb4bea6d64a1/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:29.563376 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c698e-cbef-4f99-bfd4-b2b2ed89e465 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.563750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c698e-cbef-4f99-bfd4-b2b2ed89e465 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.564376 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c698e-cbef-4f99-bfd4-b2b2ed89e465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:29.603043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-925c698e-cbef-4f99-bfd4-b2b2ed89e465 None None] MFA Rules not processed for user `b361a10f54444d169dadcb4bea6d64a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:29.604489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-925c698e-cbef-4f99-bfd4-b2b2ed89e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:29.647659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:29.713360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1111/2232] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:29.769142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533709c-fc57-45a1-af5d-be7633b820ea admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:29.866943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533709c-fc57-45a1-af5d-be7633b820ea admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:29.872390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0c6e9-691b-4e51-ace8-73b105cc6b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:29.873456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0c6e9-691b-4e51-ace8-73b105cc6b0b service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:29.873781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0c6e9-691b-4e51-ace8-73b105cc6b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:29.874149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0c6e9-691b-4e51-ace8-73b105cc6b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:30.012236 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0c6e9-691b-4e51-ace8-73b105cc6b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:30.014026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0c6e9-691b-4e51-ace8-73b105cc6b0b service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:30.025266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1122/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:32.656440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c698e-cbef-4f99-bfd4-b2b2ed89e465 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:32.674219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c698e-cbef-4f99-bfd4-b2b2ed89e465 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:32.678043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c85c-f4c3-42db-abb8-f662909a7ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:32.678737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c85c-f4c3-42db-abb8-f662909a7ebd service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:32.679034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c85c-f4c3-42db-abb8-f662909a7ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:32.679294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c85c-f4c3-42db-abb8-f662909a7ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:32.763073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393c85c-f4c3-42db-abb8-f662909a7ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:32.765192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393c85c-f4c3-42db-abb8-f662909a7ebd service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:32.776668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1112/2234] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:33.510402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0c6e9-691b-4e51-ace8-73b105cc6b0b service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:33.522695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0c6e9-691b-4e51-ace8-73b105cc6b0b service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:33.528714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11005-70a8-412c-a2ec-144862ffe266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:33.528714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11005-70a8-412c-a2ec-144862ffe266 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:33.528714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11005-70a8-412c-a2ec-144862ffe266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:33.528714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11005-70a8-412c-a2ec-144862ffe266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:33.548003 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d11005-70a8-412c-a2ec-144862ffe266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:33.549950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d11005-70a8-412c-a2ec-144862ffe266 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:33.573117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1123/2235] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:34.346151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c85c-f4c3-42db-abb8-f662909a7ebd service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:34.412882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393c85c-f4c3-42db-abb8-f662909a7ebd service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:34.417381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:34.418303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:34.418587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:34.418868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] PATH_INFO: `/v3/users/779cd54370064ebea50c70e1a122cb8c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:34.420059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=779cd54370064ebea50c70e1a122cb8c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:34.422037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:34.473649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779cd54370064ebea50c70e1a122cb8c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:34.482197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779cd54370064ebea50c70e1a122cb8c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:34.494308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:34.499831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779cd54370064ebea50c70e1a122cb8c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:34.509440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779cd54370064ebea50c70e1a122cb8c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:34.510270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779cd54370064ebea50c70e1a122cb8c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:34.517250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1113/2236] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:34 2022] DELETE /identity/v3/users/779cd54370064ebea50c70e1a122cb8c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:34.522106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d23f-a1b4-482f-b45b-0a89328c54bf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:34.522587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d23f-a1b4-482f-b45b-0a89328c54bf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:34.522794 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103d23f-a1b4-482f-b45b-0a89328c54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:34.543380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3103d23f-a1b4-482f-b45b-0a89328c54bf None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:34.544603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3103d23f-a1b4-482f-b45b-0a89328c54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:34.606717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1124/2237] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:34.618187 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:34.620923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:34.695309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12300763-b04b-4a57-b7e4-dbb217f4e7ff admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:34.699842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aee46-ac0f-49bb-a7db-524bf83b3322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:34.700612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aee46-ac0f-49bb-a7db-524bf83b3322 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:34.700912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aee46-ac0f-49bb-a7db-524bf83b3322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:34.701189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aee46-ac0f-49bb-a7db-524bf83b3322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:34.716603 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aee46-ac0f-49bb-a7db-524bf83b3322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:34.718095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aee46-ac0f-49bb-a7db-524bf83b3322 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:34.728747 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1114/2238] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:35.182657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103d23f-a1b4-482f-b45b-0a89328c54bf None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:35.184401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3103d23f-a1b4-482f-b45b-0a89328c54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:35.204157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103d23f-a1b4-482f-b45b-0a89328c54bf None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:35.211007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:35.212202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:35.212657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:35.212780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] PATH_INFO: `/v3/projects/f2745e356488482d8279db6b03db6668` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:35.214501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2745e356488482d8279db6b03db6668)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:35.217185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:35.251454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:35.269938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2745e356488482d8279db6b03db6668', 'request_id': 'req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.275564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2745e356488482d8279db6b03db6668', 'request_id': 'req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.281891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2745e356488482d8279db6b03db6668', 'request_id': 'req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.295980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] The token cache is being invalidate because project f2745e356488482d8279db6b03db6668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:35.296325 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.296943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.298654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1125/2239] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:35 2022] DELETE /identity/v3/projects/f2745e356488482d8279db6b03db6668 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:35.302968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aee46-ac0f-49bb-a7db-524bf83b3322 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:35.313195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aee46-ac0f-49bb-a7db-524bf83b3322 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:35.372411 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:35.373297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:35.373571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:35.373869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] PATH_INFO: `/v3/users/6cba5413f1344c759517e76043d6e6e2` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:35.375119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cba5413f1344c759517e76043d6e6e2)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:35.377197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:35.430004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cba5413f1344c759517e76043d6e6e2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.441402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cba5413f1344c759517e76043d6e6e2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.454289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cba5413f1344c759517e76043d6e6e2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.461245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cba5413f1344c759517e76043d6e6e2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.461920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-85656fc1-c1df-4426-9074-cafdacc071ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cba5413f1344c759517e76043d6e6e2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.468225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1115/2240] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:35 2022] DELETE /identity/v3/users/6cba5413f1344c759517e76043d6e6e2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:35.776795 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:35.779671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:35.792930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba34ebd-59a0-4d61-9697-fc83de6c5ed6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:35.854349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:35.855231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:35.855509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:35.855784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] PATH_INFO: `/v3/projects/b4b12b2b15694a3f98c2895a3660a94d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:35.856989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b12b2b15694a3f98c2895a3660a94d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:35.858951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:35.919667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b12b2b15694a3f98c2895a3660a94d', 'request_id': 'req-dc4e1de0-513e-47e2-b509-2e9b851673be'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.925252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b12b2b15694a3f98c2895a3660a94d', 'request_id': 'req-dc4e1de0-513e-47e2-b509-2e9b851673be'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.931671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b12b2b15694a3f98c2895a3660a94d', 'request_id': 'req-dc4e1de0-513e-47e2-b509-2e9b851673be'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.946380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] The token cache is being invalidate because project b4b12b2b15694a3f98c2895a3660a94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:35.946654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.947245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-dc4e1de0-513e-47e2-b509-2e9b851673be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:35.948808 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1126/2241] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:35 2022] DELETE /identity/v3/projects/b4b12b2b15694a3f98c2895a3660a94d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:35.953819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca159-bd0f-4bae-ad02-3d8bfda570d5 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:35.954130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca159-bd0f-4bae-ad02-3d8bfda570d5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:35.954430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca159-bd0f-4bae-ad02-3d8bfda570d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:35.962788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:35.978377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-613ca159-bd0f-4bae-ad02-3d8bfda570d5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:35.979964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-613ca159-bd0f-4bae-ad02-3d8bfda570d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:36.045259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1116/2242] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:36.055242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd436-862a-41eb-a8b3-45c8188cc398 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.055644 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd436-862a-41eb-a8b3-45c8188cc398 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.055991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd436-862a-41eb-a8b3-45c8188cc398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.075252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3e4fd436-862a-41eb-a8b3-45c8188cc398 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:36.076562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3e4fd436-862a-41eb-a8b3-45c8188cc398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:36.085480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1127/2243] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:36.089778 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ca159-bd0f-4bae-ad02-3d8bfda570d5 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:36.101272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ca159-bd0f-4bae-ad02-3d8bfda570d5 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:36.111383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:36.112801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.113085 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.113433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.114207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:36.114520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:36.116170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:36.141485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd436-862a-41eb-a8b3-45c8188cc398 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:36.147505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1117/2244] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:13:36.151741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd436-862a-41eb-a8b3-45c8188cc398 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:36.157294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c38d8-9552-4621-b324-eec1d38bdb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:36.157640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c38d8-9552-4621-b324-eec1d38bdb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.158292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c38d8-9552-4621-b324-eec1d38bdb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.158576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c38d8-9552-4621-b324-eec1d38bdb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.159287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c38d8-9552-4621-b324-eec1d38bdb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:36.162269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c38d8-9552-4621-b324-eec1d38bdb92 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:36.231572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1128/2245] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:36.235548 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:36.247084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e0ec-1295-41ac-93d1-dd7d7b28fd43 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:36.311720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a4ac1-b65b-4afa-ab8a-88820308d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:36.312403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4ac1-b65b-4afa-ab8a-88820308d0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.313034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4ac1-b65b-4afa-ab8a-88820308d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.313312 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4ac1-b65b-4afa-ab8a-88820308d0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.314088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a4ac1-b65b-4afa-ab8a-88820308d0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:36.316029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a4ac1-b65b-4afa-ab8a-88820308d0a1 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:36.338186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1118/2246] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:36 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:36.342490 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c38d8-9552-4621-b324-eec1d38bdb92 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:36.353636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c38d8-9552-4621-b324-eec1d38bdb92 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:36.359507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31606f-0850-4666-97ea-0a92ed5cf26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:36.360170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31606f-0850-4666-97ea-0a92ed5cf26e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.360452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31606f-0850-4666-97ea-0a92ed5cf26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.360718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31606f-0850-4666-97ea-0a92ed5cf26e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.361451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31606f-0850-4666-97ea-0a92ed5cf26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:36.363095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31606f-0850-4666-97ea-0a92ed5cf26e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:36.374675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1129/2247] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:36.378876 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a4ac1-b65b-4afa-ab8a-88820308d0a1 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:36.390920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a4ac1-b65b-4afa-ab8a-88820308d0a1 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:36.397226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a8ebf-d277-4416-94e7-4f9ffc5af65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:36.397908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8ebf-d277-4416-94e7-4f9ffc5af65e admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.398209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8ebf-d277-4416-94e7-4f9ffc5af65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.398481 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8ebf-d277-4416-94e7-4f9ffc5af65e admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.399207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a8ebf-d277-4416-94e7-4f9ffc5af65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:36.400833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a8ebf-d277-4416-94e7-4f9ffc5af65e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:36.411720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1119/2248] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:36.416197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31606f-0850-4666-97ea-0a92ed5cf26e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:36.423053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:36.428075 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31606f-0850-4666-97ea-0a92ed5cf26e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:36.434763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:36.435868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.436565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.436837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] PATH_INFO: `/v3/projects/f275cde4f8184f0b850590f597e921a4/users/ac2a3db386b548a593f69f7be18825a0/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.454760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f275cde4f8184f0b850590f597e921a4, user_id=ac2a3db386b548a593f69f7be18825a0, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:36.458119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:36.473979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1130/2249] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:36 2022] PUT /identity/v3/projects/f275cde4f8184f0b850590f597e921a4/users/ac2a3db386b548a593f69f7be18825a0/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:36.479450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54ec9-8847-4d4c-a92c-0171f65eda33 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.479739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54ec9-8847-4d4c-a92c-0171f65eda33 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.480012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54ec9-8847-4d4c-a92c-0171f65eda33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.499125 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-eaa54ec9-8847-4d4c-a92c-0171f65eda33 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:36.500336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-eaa54ec9-8847-4d4c-a92c-0171f65eda33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:36.572539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1120/2250] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:36.582902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:36.584736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:36.658370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f043e-7bc4-49da-81ff-036b446c0bb7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:36.662658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1f277-3f97-46b7-9db2-ee91166a83a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:36.663321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1f277-3f97-46b7-9db2-ee91166a83a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:36.663598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1f277-3f97-46b7-9db2-ee91166a83a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:36.663868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1f277-3f97-46b7-9db2-ee91166a83a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:36.673514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1f277-3f97-46b7-9db2-ee91166a83a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:36.674925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1f277-3f97-46b7-9db2-ee91166a83a1 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:36.688649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1131/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:37.448300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7596-2e65-4fab-8bdd-06c19cba5e9b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:37.448800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7596-2e65-4fab-8bdd-06c19cba5e9b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:37.449047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7596-2e65-4fab-8bdd-06c19cba5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:37.489241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:37.507848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-eebb7596-2e65-4fab-8bdd-06c19cba5e9b None None] MFA Rules not processed for user `ac2a3db386b548a593f69f7be18825a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:37.510042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-eebb7596-2e65-4fab-8bdd-06c19cba5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:37.611808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1121/2252] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:37.616467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1f277-3f97-46b7-9db2-ee91166a83a1 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:37.626459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1f277-3f97-46b7-9db2-ee91166a83a1 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:37.631827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629bc9-f46b-4921-a917-c02df676466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:37.632496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629bc9-f46b-4921-a917-c02df676466c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:37.632777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629bc9-f46b-4921-a917-c02df676466c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:37.633053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629bc9-f46b-4921-a917-c02df676466c admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:37.633760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629bc9-f46b-4921-a917-c02df676466c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:37.635893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629bc9-f46b-4921-a917-c02df676466c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:37.683522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1132/2253] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:37 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:37.685086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7596-2e65-4fab-8bdd-06c19cba5e9b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:37.701212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7596-2e65-4fab-8bdd-06c19cba5e9b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:37.772978 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c2949-68f3-42d7-8d0b-21a25fccc516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:37.774497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2949-68f3-42d7-8d0b-21a25fccc516 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:37.774775 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2949-68f3-42d7-8d0b-21a25fccc516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:37.775196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c2949-68f3-42d7-8d0b-21a25fccc516 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:37.776047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c2949-68f3-42d7-8d0b-21a25fccc516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:37.778095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c2949-68f3-42d7-8d0b-21a25fccc516 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:37.810839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1122/2254] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:37 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:13:37.815151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629bc9-f46b-4921-a917-c02df676466c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:37.826177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629bc9-f46b-4921-a917-c02df676466c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:37.833258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb84eab-f917-416c-b21f-a28169c57a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:37.833995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb84eab-f917-416c-b21f-a28169c57a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:37.834283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb84eab-f917-416c-b21f-a28169c57a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:37.834562 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb84eab-f917-416c-b21f-a28169c57a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:37.835371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb84eab-f917-416c-b21f-a28169c57a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:37.838570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb84eab-f917-416c-b21f-a28169c57a1b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:37.851187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1133/2255] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:37.855393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c2949-68f3-42d7-8d0b-21a25fccc516 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:37.866562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c2949-68f3-42d7-8d0b-21a25fccc516 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:37.872552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a639cc5-5aa1-4221-aed3-b2e894a8574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:37.873550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a639cc5-5aa1-4221-aed3-b2e894a8574a admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:37.874093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a639cc5-5aa1-4221-aed3-b2e894a8574a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:37.874514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a639cc5-5aa1-4221-aed3-b2e894a8574a admin admin] PATH_INFO: `/v3/projects/6df1cc7111d34e52824af8049b74e98b/users/f2ae88fffc354e7d8d58f50c7383608c/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:37.893431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a639cc5-5aa1-4221-aed3-b2e894a8574a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df1cc7111d34e52824af8049b74e98b, user_id=f2ae88fffc354e7d8d58f50c7383608c, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:37.897609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a639cc5-5aa1-4221-aed3-b2e894a8574a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:37.917297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1123/2256] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:37 2022] PUT /identity/v3/projects/6df1cc7111d34e52824af8049b74e98b/users/f2ae88fffc354e7d8d58f50c7383608c/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:37.921489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb84eab-f917-416c-b21f-a28169c57a1b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:37.931876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb84eab-f917-416c-b21f-a28169c57a1b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:38.005668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6726862-99e6-4814-a93b-6b8363c4edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:38.006375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6726862-99e6-4814-a93b-6b8363c4edaa admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:38.006661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6726862-99e6-4814-a93b-6b8363c4edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:38.006937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6726862-99e6-4814-a93b-6b8363c4edaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:38.007674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6726862-99e6-4814-a93b-6b8363c4edaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:38.009277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6726862-99e6-4814-a93b-6b8363c4edaa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:38.023468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1134/2257] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:38.024673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a639cc5-5aa1-4221-aed3-b2e894a8574a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:38.034967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a639cc5-5aa1-4221-aed3-b2e894a8574a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:38.040108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:38.041229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:38.041517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:38.041867 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] PATH_INFO: `/v3/projects/6df1cc7111d34e52824af8049b74e98b/users/f2ae88fffc354e7d8d58f50c7383608c/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:38.043896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df1cc7111d34e52824af8049b74e98b, user_id=f2ae88fffc354e7d8d58f50c7383608c, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:38.046679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:38.059074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1124/2258] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:38 2022] PUT /identity/v3/projects/6df1cc7111d34e52824af8049b74e98b/users/f2ae88fffc354e7d8d58f50c7383608c/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:38.831334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37c70-894b-4363-ba21-db296584ad8c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:38.831927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37c70-894b-4363-ba21-db296584ad8c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:38.832213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37c70-894b-4363-ba21-db296584ad8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:38.867739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a4d37c70-894b-4363-ba21-db296584ad8c None None] MFA Rules not processed for user `f2ae88fffc354e7d8d58f50c7383608c`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:38.869270 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a4d37c70-894b-4363-ba21-db296584ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:38.913876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:38.934803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:38.943554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:38.959033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1135/2259] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:38.974994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37c70-894b-4363-ba21-db296584ad8c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:38.976534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a4d37c70-894b-4363-ba21-db296584ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:39.027477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:39.047332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6100e56-a03f-46bb-b597-9ce223cefbec admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:39.049239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37c70-894b-4363-ba21-db296584ad8c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:39.052812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:39.053629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895ebe6-951a-44ea-8f9c-a3cd2c47b294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:39.053850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:39.054717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ebe6-951a-44ea-8f9c-a3cd2c47b294 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:39.054828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:39.054921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ebe6-951a-44ea-8f9c-a3cd2c47b294 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:39.055007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] PATH_INFO: `/v3/users/fddd91d0876940faba524126a1ea258c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:39.055082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ebe6-951a-44ea-8f9c-a3cd2c47b294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:39.055937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddd91d0876940faba524126a1ea258c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:39.057976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:39.132099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddd91d0876940faba524126a1ea258c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:39.151686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddd91d0876940faba524126a1ea258c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:39.157266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895ebe6-951a-44ea-8f9c-a3cd2c47b294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:39.158926 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895ebe6-951a-44ea-8f9c-a3cd2c47b294 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:39.169333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1136/2260] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:13:39.180972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddd91d0876940faba524126a1ea258c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:39.190808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddd91d0876940faba524126a1ea258c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:39.191575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddd91d0876940faba524126a1ea258c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:39.198579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1125/2261] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:38 2022] DELETE /identity/v3/users/fddd91d0876940faba524126a1ea258c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:39.203242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d3c5d-5a9a-497a-9fe7-a0fd50ac823a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:39.203571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d3c5d-5a9a-497a-9fe7-a0fd50ac823a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:39.203852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d3c5d-5a9a-497a-9fe7-a0fd50ac823a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:39.223565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bd5d3c5d-5a9a-497a-9fe7-a0fd50ac823a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:39.225123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd5d3c5d-5a9a-497a-9fe7-a0fd50ac823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:39.344415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1137/2262] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:39.356172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:39.357608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:39.441060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1398c6-b91c-41f2-9b75-7dfe4ac38f91 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:39.448448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd187d4-7fc5-4bd0-a8c7-f4642d1a4df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:39.449218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd187d4-7fc5-4bd0-a8c7-f4642d1a4df2 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:39.449502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd187d4-7fc5-4bd0-a8c7-f4642d1a4df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:39.449776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd187d4-7fc5-4bd0-a8c7-f4642d1a4df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:39.462951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd187d4-7fc5-4bd0-a8c7-f4642d1a4df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:39.465073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd187d4-7fc5-4bd0-a8c7-f4642d1a4df2 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:39.483236 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1126/2263] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:39.952942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d3c5d-5a9a-497a-9fe7-a0fd50ac823a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:39.954551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd5d3c5d-5a9a-497a-9fe7-a0fd50ac823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:39.966932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d3c5d-5a9a-497a-9fe7-a0fd50ac823a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:39.971666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:39.972631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:39.972921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:39.973255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] PATH_INFO: `/v3/projects/ed616463f0f94e55bdb5b620462434f4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:39.974581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed616463f0f94e55bdb5b620462434f4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:39.976571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:40.027910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:40.060126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed616463f0f94e55bdb5b620462434f4', 'request_id': 'req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.066271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed616463f0f94e55bdb5b620462434f4', 'request_id': 'req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.072578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed616463f0f94e55bdb5b620462434f4', 'request_id': 'req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.088083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] The token cache is being invalidate because project ed616463f0f94e55bdb5b620462434f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:40.088373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.089009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.090637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1138/2264] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:39 2022] DELETE /identity/v3/projects/ed616463f0f94e55bdb5b620462434f4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:40.095340 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd187d4-7fc5-4bd0-a8c7-f4642d1a4df2 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:40.105871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd187d4-7fc5-4bd0-a8c7-f4642d1a4df2 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:40.163996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:40.164930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:40.165208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:40.165484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] PATH_INFO: `/v3/users/4f4912bc1db74d4aadb359248d81a1e1` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:40.166829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4912bc1db74d4aadb359248d81a1e1)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:40.168756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:40.185396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:40.217763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4912bc1db74d4aadb359248d81a1e1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.227057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4912bc1db74d4aadb359248d81a1e1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.238765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4912bc1db74d4aadb359248d81a1e1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.245821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4912bc1db74d4aadb359248d81a1e1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.246549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4912bc1db74d4aadb359248d81a1e1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.252611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1127/2265] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:40 2022] DELETE /identity/v3/users/4f4912bc1db74d4aadb359248d81a1e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:40.557450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:40.559095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:40.573739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d22f2-3f5a-4b86-b255-6265777bf0d6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:40.642997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:40.643873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:40.644146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:40.644463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] PATH_INFO: `/v3/projects/54ec4ea8a18b465c8fe56cdf43d8d31c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:40.645642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ec4ea8a18b465c8fe56cdf43d8d31c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:40.647576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:40.715139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ec4ea8a18b465c8fe56cdf43d8d31c', 'request_id': 'req-7e70d847-af2a-401b-aa84-441d1877a4e0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.723302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ec4ea8a18b465c8fe56cdf43d8d31c', 'request_id': 'req-7e70d847-af2a-401b-aa84-441d1877a4e0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.732461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:40.733948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ec4ea8a18b465c8fe56cdf43d8d31c', 'request_id': 'req-7e70d847-af2a-401b-aa84-441d1877a4e0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.734062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:40.751574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] The token cache is being invalidate because project 54ec4ea8a18b465c8fe56cdf43d8d31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:40.751865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.752515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.757350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1139/2266] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:40 2022] DELETE /identity/v3/projects/54ec4ea8a18b465c8fe56cdf43d8d31c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:40.758125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:40.759459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:40.814745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99dbaa-e711-48c0-b89a-94598eb982c3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:40.815215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:40.843475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70d847-af2a-401b-aa84-441d1877a4e0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:40.848789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:40.849688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:40.850001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:40.850277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] PATH_INFO: `/v3/users/b361a10f54444d169dadcb4bea6d64a1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:40.851567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b361a10f54444d169dadcb4bea6d64a1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:40.853574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:40.877021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:40.877660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:40.878095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:40.878430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:40.880767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:40.932484 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b361a10f54444d169dadcb4bea6d64a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.933512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b361a10f54444d169dadcb4bea6d64a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.945572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b361a10f54444d169dadcb4bea6d64a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.958601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b361a10f54444d169dadcb4bea6d64a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:40.960558 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:40.962847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:40.969756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:40.982339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1128/2267] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:40.991311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2c4908a9-5fa6-4c5c-a2e6-c68a5845b771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b361a10f54444d169dadcb4bea6d64a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:41.000457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1140/2268] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:40 2022] DELETE /identity/v3/users/b361a10f54444d169dadcb4bea6d64a1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:41.652820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:41.664727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30485c7b-a80d-4f61-a273-d6290ef990b9 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:41.747197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:41.748304 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:41.748596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:41.748874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] PATH_INFO: `/v3/projects/4f8270e37dfa4a29bd62e5e1c22d7605` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:41.750153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8270e37dfa4a29bd62e5e1c22d7605)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:41.752229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:41.822973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8270e37dfa4a29bd62e5e1c22d7605', 'request_id': 'req-cdf9a416-8e09-42aa-9629-054ef45faeaa'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:41.831569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8270e37dfa4a29bd62e5e1c22d7605', 'request_id': 'req-cdf9a416-8e09-42aa-9629-054ef45faeaa'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:41.841707 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8270e37dfa4a29bd62e5e1c22d7605', 'request_id': 'req-cdf9a416-8e09-42aa-9629-054ef45faeaa'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:41.858011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] The token cache is being invalidate because project 4f8270e37dfa4a29bd62e5e1c22d7605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:41.858536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:41.859274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-cdf9a416-8e09-42aa-9629-054ef45faeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:41.864426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1129/2269] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:41 2022] DELETE /identity/v3/projects/4f8270e37dfa4a29bd62e5e1c22d7605 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:41.870884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40e0c-d793-41f7-b23e-f2b39f630bd1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:41.871189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40e0c-d793-41f7-b23e-f2b39f630bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:41.871499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40e0c-d793-41f7-b23e-f2b39f630bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:41.893246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e0d40e0c-d793-41f7-b23e-f2b39f630bd1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:41.897668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e0d40e0c-d793-41f7-b23e-f2b39f630bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:41.996525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1141/2270] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:42.004401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706ac-4ae9-4d97-a0ed-a397c6cf8296 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.005174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706ac-4ae9-4d97-a0ed-a397c6cf8296 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.005625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706ac-4ae9-4d97-a0ed-a397c6cf8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.025663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e1e706ac-4ae9-4d97-a0ed-a397c6cf8296 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:42.027229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e1e706ac-4ae9-4d97-a0ed-a397c6cf8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:42.038367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1130/2271] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:13:42.042093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d40e0c-d793-41f7-b23e-f2b39f630bd1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:42.052292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d40e0c-d793-41f7-b23e-f2b39f630bd1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:42.057121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:42.057831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.058300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.058707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.059459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:42.059768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:42.062282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:42.097214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1142/2272] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:13:42.098540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e706ac-4ae9-4d97-a0ed-a397c6cf8296 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:42.121694 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e706ac-4ae9-4d97-a0ed-a397c6cf8296 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:42.147529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71060fed-7b03-435d-ba94-e04410e623a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:42.148743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71060fed-7b03-435d-ba94-e04410e623a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.148871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71060fed-7b03-435d-ba94-e04410e623a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.150048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71060fed-7b03-435d-ba94-e04410e623a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.151171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71060fed-7b03-435d-ba94-e04410e623a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:42.154332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71060fed-7b03-435d-ba94-e04410e623a3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:42.213770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1131/2273] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:42 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:42.215147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:42.240713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447d6ce-adaf-4862-9d6f-e29afe0f92ce admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:42.349470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:42.374565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03c41c-f516-4d68-9ff2-e28643bc7e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:42.375692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c41c-f516-4d68-9ff2-e28643bc7e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.375831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c41c-f516-4d68-9ff2-e28643bc7e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.378182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c41c-f516-4d68-9ff2-e28643bc7e02 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.381099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03c41c-f516-4d68-9ff2-e28643bc7e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:42.383453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03c41c-f516-4d68-9ff2-e28643bc7e02 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:42.419304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1143/2274] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:42 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:42.425928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71060fed-7b03-435d-ba94-e04410e623a3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:42.442222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71060fed-7b03-435d-ba94-e04410e623a3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:42.447489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dedc81-91c7-4cb8-b444-2325f18d14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:42.448834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dedc81-91c7-4cb8-b444-2325f18d14e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.449118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dedc81-91c7-4cb8-b444-2325f18d14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.449393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dedc81-91c7-4cb8-b444-2325f18d14e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.450190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dedc81-91c7-4cb8-b444-2325f18d14e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:42.452229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dedc81-91c7-4cb8-b444-2325f18d14e0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:42.467548 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1132/2275] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:42.471746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03c41c-f516-4d68-9ff2-e28643bc7e02 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:42.485759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03c41c-f516-4d68-9ff2-e28643bc7e02 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:42.492719 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c22795-ee2f-46fd-b789-aff8f40a8909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:42.493659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c22795-ee2f-46fd-b789-aff8f40a8909 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.494066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c22795-ee2f-46fd-b789-aff8f40a8909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.494554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c22795-ee2f-46fd-b789-aff8f40a8909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.495429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c22795-ee2f-46fd-b789-aff8f40a8909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:42.497129 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c22795-ee2f-46fd-b789-aff8f40a8909 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:42.509568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1144/2276] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:42.513955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dedc81-91c7-4cb8-b444-2325f18d14e0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:42.527949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dedc81-91c7-4cb8-b444-2325f18d14e0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:42.533032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:42.534098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.534448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.534712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] PATH_INFO: `/v3/projects/99c8d1e8f35e461dbdc25783106e4a44/users/4d5064e0f807490ab7f83657ff51a09f/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.559028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c8d1e8f35e461dbdc25783106e4a44, user_id=4d5064e0f807490ab7f83657ff51a09f, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:42.562800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:42.579454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1133/2277] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:42 2022] PUT /identity/v3/projects/99c8d1e8f35e461dbdc25783106e4a44/users/4d5064e0f807490ab7f83657ff51a09f/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:42.590270 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4bca-994a-4893-abb9-04766faec088 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.590696 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4bca-994a-4893-abb9-04766faec088 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.591120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4bca-994a-4893-abb9-04766faec088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.647521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-042d4bca-994a-4893-abb9-04766faec088 None None] MFA Rules not processed for user `4d5064e0f807490ab7f83657ff51a09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:42.649640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-042d4bca-994a-4893-abb9-04766faec088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:42.748830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1145/2278] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:42.757910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:42.760056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:42.804159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:42.841535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94b3c2-8ac2-4e40-a38b-d4386826422e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:42.845570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d534b1b-9b04-4c23-b377-119c2bdc238c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:42.846293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d534b1b-9b04-4c23-b377-119c2bdc238c service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:42.846562 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d534b1b-9b04-4c23-b377-119c2bdc238c service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:42.846855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d534b1b-9b04-4c23-b377-119c2bdc238c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:42.860496 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d534b1b-9b04-4c23-b377-119c2bdc238c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:42.862243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d534b1b-9b04-4c23-b377-119c2bdc238c service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:42.872469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1134/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:45.005280 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d4bca-994a-4893-abb9-04766faec088 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:45.006863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-042d4bca-994a-4893-abb9-04766faec088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:45.089213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d4bca-994a-4893-abb9-04766faec088 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:45.095751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:45.096910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:45.097008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:45.097388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] PATH_INFO: `/v3/users/41bc70e58a764f7e9e065aead58c425a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:45.098801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bc70e58a764f7e9e065aead58c425a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:45.100765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:45.167662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bc70e58a764f7e9e065aead58c425a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.168333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bc70e58a764f7e9e065aead58c425a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.177284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bc70e58a764f7e9e065aead58c425a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.179557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:45.186373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bc70e58a764f7e9e065aead58c425a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.200342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ae41b89-6cf1-4c61-a48c-ff2ea85c14b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bc70e58a764f7e9e065aead58c425a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.206979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1146/2280] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:13:45 2022] DELETE /identity/v3/users/41bc70e58a764f7e9e065aead58c425a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:45.438768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d534b1b-9b04-4c23-b377-119c2bdc238c service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:45.454414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d534b1b-9b04-4c23-b377-119c2bdc238c service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:45.528935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:45.529890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:45.530653 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:45.530940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] PATH_INFO: `/v3/projects/8355cfdfed4f44f689922335c2845c50` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:45.532162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8355cfdfed4f44f689922335c2845c50)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:45.534169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:45.582621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8355cfdfed4f44f689922335c2845c50', 'request_id': 'req-a3f60569-824b-481b-b872-b91860724f80'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.588631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8355cfdfed4f44f689922335c2845c50', 'request_id': 'req-a3f60569-824b-481b-b872-b91860724f80'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.595538 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8355cfdfed4f44f689922335c2845c50', 'request_id': 'req-a3f60569-824b-481b-b872-b91860724f80'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.610099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] The token cache is being invalidate because project 8355cfdfed4f44f689922335c2845c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:13:45.610413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.611049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a3f60569-824b-481b-b872-b91860724f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:13:45.612605 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1135/2281] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:13:45 2022] DELETE /identity/v3/projects/8355cfdfed4f44f689922335c2845c50 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:45.617885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353283c0-70b3-4f4e-b630-43626d7cdb68 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:45.618179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353283c0-70b3-4f4e-b630-43626d7cdb68 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:45.618455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353283c0-70b3-4f4e-b630-43626d7cdb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:45.637433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-353283c0-70b3-4f4e-b630-43626d7cdb68 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:45.638698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-353283c0-70b3-4f4e-b630-43626d7cdb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:45.707536 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1147/2282] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:45.715360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d240-fabf-473a-8496-f3b014a82cad None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:45.715646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d240-fabf-473a-8496-f3b014a82cad None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:45.715918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d240-fabf-473a-8496-f3b014a82cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:45.734662 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0b15d240-fabf-473a-8496-f3b014a82cad None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:45.735906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0b15d240-fabf-473a-8496-f3b014a82cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:45.745226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1136/2283] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:45.749776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353283c0-70b3-4f4e-b630-43626d7cdb68 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:45.760369 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353283c0-70b3-4f4e-b630-43626d7cdb68 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:45.766547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:45.767247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:45.767525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:45.767792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:45.768532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:13:45.769104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:45.770921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:45.788679 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1148/2284] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:13:45.795301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15d240-fabf-473a-8496-f3b014a82cad None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:45.809348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15d240-fabf-473a-8496-f3b014a82cad None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:45.815902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de853-005b-4882-a243-0c81d2a154f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:45.816666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de853-005b-4882-a243-0c81d2a154f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:45.816945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de853-005b-4882-a243-0c81d2a154f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:45.817221 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de853-005b-4882-a243-0c81d2a154f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:45.817991 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2de853-005b-4882-a243-0c81d2a154f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:45.819901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2de853-005b-4882-a243-0c81d2a154f7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:45.851080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1137/2285] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:45 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:45.855372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:45.866109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229cacb-8e9b-41de-bcc9-af9aaaf735be admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:45.928829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434959-623c-4f9e-bb2e-93f5aea6b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:45.930237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434959-623c-4f9e-bb2e-93f5aea6b648 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:45.930237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434959-623c-4f9e-bb2e-93f5aea6b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:45.930237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434959-623c-4f9e-bb2e-93f5aea6b648 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:45.930845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c434959-623c-4f9e-bb2e-93f5aea6b648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:45.934481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c434959-623c-4f9e-bb2e-93f5aea6b648 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:45.964194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1149/2286] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:45 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:45.968868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de853-005b-4882-a243-0c81d2a154f7 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:45.984939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de853-005b-4882-a243-0c81d2a154f7 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:45.991192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27095927-8a0f-497d-9480-c505616db3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:45.991877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27095927-8a0f-497d-9480-c505616db3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:45.992158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27095927-8a0f-497d-9480-c505616db3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:45.992437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27095927-8a0f-497d-9480-c505616db3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:45.993191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27095927-8a0f-497d-9480-c505616db3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:45.994934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27095927-8a0f-497d-9480-c505616db3c3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.008053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1138/2287] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:46.012650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434959-623c-4f9e-bb2e-93f5aea6b648 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.026653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434959-623c-4f9e-bb2e-93f5aea6b648 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.033670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff255-fd83-46ba-87b7-d5a83e7405a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.034380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff255-fd83-46ba-87b7-d5a83e7405a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.034792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff255-fd83-46ba-87b7-d5a83e7405a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.035156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff255-fd83-46ba-87b7-d5a83e7405a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.035923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dff255-fd83-46ba-87b7-d5a83e7405a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.037652 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dff255-fd83-46ba-87b7-d5a83e7405a8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.049470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1150/2288] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:46.054207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27095927-8a0f-497d-9480-c505616db3c3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.066899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27095927-8a0f-497d-9480-c505616db3c3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.072261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0195014-6ed1-4556-9aa8-8a029db6819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.073141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0195014-6ed1-4556-9aa8-8a029db6819c admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.073419 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0195014-6ed1-4556-9aa8-8a029db6819c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.073698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0195014-6ed1-4556-9aa8-8a029db6819c admin admin] PATH_INFO: `/v3/projects/88d99f01f94140cfbf7e55ccb7b1442e/users/94928e495cf44eb9894fa51f0f3538b3/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.093826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0195014-6ed1-4556-9aa8-8a029db6819c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d99f01f94140cfbf7e55ccb7b1442e, user_id=94928e495cf44eb9894fa51f0f3538b3, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.096761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0195014-6ed1-4556-9aa8-8a029db6819c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.100346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:46.115006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1139/2289] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:46 2022] PUT /identity/v3/projects/88d99f01f94140cfbf7e55ccb7b1442e/users/94928e495cf44eb9894fa51f0f3538b3/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:46.127968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795245-f3bb-458b-9589-1b7d4ba0c3a4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.128259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795245-f3bb-458b-9589-1b7d4ba0c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.128572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795245-f3bb-458b-9589-1b7d4ba0c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.159199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6f795245-f3bb-458b-9589-1b7d4ba0c3a4 None None] MFA Rules not processed for user `94928e495cf44eb9894fa51f0f3538b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:46.160461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6f795245-f3bb-458b-9589-1b7d4ba0c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:46.190792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:46.233093 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1151/2290] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:46.241201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0195014-6ed1-4556-9aa8-8a029db6819c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.317188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0195014-6ed1-4556-9aa8-8a029db6819c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.323201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef7600-6051-4398-aded-023460101bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.323887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef7600-6051-4398-aded-023460101bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.324164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef7600-6051-4398-aded-023460101bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.324432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef7600-6051-4398-aded-023460101bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.326875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef7600-6051-4398-aded-023460101bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.327112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef7600-6051-4398-aded-023460101bc3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.363271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1140/2291] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:13:46 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:46.367011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795245-f3bb-458b-9589-1b7d4ba0c3a4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.379296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795245-f3bb-458b-9589-1b7d4ba0c3a4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.463059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ee2b-0c29-4be0-a493-3137645d1ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.463757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ee2b-0c29-4be0-a493-3137645d1ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.464100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ee2b-0c29-4be0-a493-3137645d1ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.464645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ee2b-0c29-4be0-a493-3137645d1ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.465868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ee2b-0c29-4be0-a493-3137645d1ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.467849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ee2b-0c29-4be0-a493-3137645d1ad2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.496203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1152/2292] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:13:46 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:13:46.500651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef7600-6051-4398-aded-023460101bc3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.514079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef7600-6051-4398-aded-023460101bc3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.519458 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971e35-9518-42cc-9006-6618b5237f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.520249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971e35-9518-42cc-9006-6618b5237f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.520602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971e35-9518-42cc-9006-6618b5237f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.520994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971e35-9518-42cc-9006-6618b5237f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.521893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a971e35-9518-42cc-9006-6618b5237f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.523688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a971e35-9518-42cc-9006-6618b5237f83 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.540028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1141/2293] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:13:46.541020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ee2b-0c29-4be0-a493-3137645d1ad2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.552415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ee2b-0c29-4be0-a493-3137645d1ad2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.559079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d7e60-8f90-4c31-9713-a5038bed353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.559995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7e60-8f90-4c31-9713-a5038bed353a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.560264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7e60-8f90-4c31-9713-a5038bed353a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.560545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7e60-8f90-4c31-9713-a5038bed353a admin admin] PATH_INFO: `/v3/projects/ce2245a47bf54de0a4264e247abd8daa/users/72156ee2573f47e5bb4f7bfe17a2c465/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.578337 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d7e60-8f90-4c31-9713-a5038bed353a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2245a47bf54de0a4264e247abd8daa, user_id=72156ee2573f47e5bb4f7bfe17a2c465, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.581014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d7e60-8f90-4c31-9713-a5038bed353a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.596260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1153/2294] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:46 2022] PUT /identity/v3/projects/ce2245a47bf54de0a4264e247abd8daa/users/72156ee2573f47e5bb4f7bfe17a2c465/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:13:46.600451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971e35-9518-42cc-9006-6618b5237f83 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.615010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971e35-9518-42cc-9006-6618b5237f83 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.688276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf541e-97f9-4563-b4d7-1a3b4afc5c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.689471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf541e-97f9-4563-b4d7-1a3b4afc5c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.689755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf541e-97f9-4563-b4d7-1a3b4afc5c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.690067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf541e-97f9-4563-b4d7-1a3b4afc5c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.691202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf541e-97f9-4563-b4d7-1a3b4afc5c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.694055 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf541e-97f9-4563-b4d7-1a3b4afc5c8b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.710687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1142/2295] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:13:46.712238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d7e60-8f90-4c31-9713-a5038bed353a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.723472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d7e60-8f90-4c31-9713-a5038bed353a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.728339 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.729237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.729530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.729843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] PATH_INFO: `/v3/projects/ce2245a47bf54de0a4264e247abd8daa/users/72156ee2573f47e5bb4f7bfe17a2c465/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.732401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2245a47bf54de0a4264e247abd8daa, user_id=72156ee2573f47e5bb4f7bfe17a2c465, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.735144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.746708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1154/2296] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:13:46 2022] PUT /identity/v3/projects/ce2245a47bf54de0a4264e247abd8daa/users/72156ee2573f47e5bb4f7bfe17a2c465/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:13:46.761505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4c31a-cc59-4069-8f3b-2c2d4ffae2a4 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.761815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4c31a-cc59-4069-8f3b-2c2d4ffae2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.762108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4c31a-cc59-4069-8f3b-2c2d4ffae2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.794760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-caf4c31a-cc59-4069-8f3b-2c2d4ffae2a4 None None] MFA Rules not processed for user `72156ee2573f47e5bb4f7bfe17a2c465`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:46.796154 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-caf4c31a-cc59-4069-8f3b-2c2d4ffae2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:46.860199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:46.880666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1143/2297] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:46.892214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:46.894121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:46.955815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1a6bc-9625-4ef3-8ccf-94f5229bae39 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:46.960782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490586-ce40-4c68-8d86-4ffbb68aa487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:46.961467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490586-ce40-4c68-8d86-4ffbb68aa487 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:46.961750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490586-ce40-4c68-8d86-4ffbb68aa487 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:46.962062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490586-ce40-4c68-8d86-4ffbb68aa487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:46.972202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490586-ce40-4c68-8d86-4ffbb68aa487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:46.973598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490586-ce40-4c68-8d86-4ffbb68aa487 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:46.983785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1155/2298] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:47.059890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4c31a-cc59-4069-8f3b-2c2d4ffae2a4 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:13:47.071387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4c31a-cc59-4069-8f3b-2c2d4ffae2a4 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:13:47.077947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3dced-4d62-4740-96fe-e2541baecb5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:13:47.079078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3dced-4d62-4740-96fe-e2541baecb5d service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:47.079447 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3dced-4d62-4740-96fe-e2541baecb5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:47.079750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3dced-4d62-4740-96fe-e2541baecb5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:47.147267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3dced-4d62-4740-96fe-e2541baecb5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:13:47.149096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3dced-4d62-4740-96fe-e2541baecb5d service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:13:47.159169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1144/2299] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:13:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:13:51.783451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320972-fb48-4d50-aae4-c2f64d0f261b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:51.784411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320972-fb48-4d50-aae4-c2f64d0f261b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:51.785061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320972-fb48-4d50-aae4-c2f64d0f261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:51.827455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-34320972-fb48-4d50-aae4-c2f64d0f261b None None] MFA Rules not processed for user `4d5064e0f807490ab7f83657ff51a09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:51.828799 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-34320972-fb48-4d50-aae4-c2f64d0f261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:51.850804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:13:51.889693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1156/2300] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:13:54.515434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883e13f-17c4-4599-b5da-2ae7620635a7 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:13:54.515966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883e13f-17c4-4599-b5da-2ae7620635a7 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:13:54.515966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883e13f-17c4-4599-b5da-2ae7620635a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:13:54.539462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2883e13f-17c4-4599-b5da-2ae7620635a7 None None] MFA Rules not processed for user `89d1af25b199404b9f432b21c825b447`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:13:54.540660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2883e13f-17c4-4599-b5da-2ae7620635a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:13:54.614772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1145/2301] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:13:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:01.881156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=14 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:04.599039 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=57 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:04.898705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320972-fb48-4d50-aae4-c2f64d0f261b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:04.900244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-34320972-fb48-4d50-aae4-c2f64d0f261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:04.964943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320972-fb48-4d50-aae4-c2f64d0f261b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:04.969856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:04.970770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:04.971084 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:04.971358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] PATH_INFO: `/v3/users/33bbbac0dcd84e5e9c50d47978fe9292` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:04.972755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bbbac0dcd84e5e9c50d47978fe9292)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:04.974778 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:05.031784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bbbac0dcd84e5e9c50d47978fe9292'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.032626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bbbac0dcd84e5e9c50d47978fe9292'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.042589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bbbac0dcd84e5e9c50d47978fe9292'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.050660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bbbac0dcd84e5e9c50d47978fe9292'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.064111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bbbac0dcd84e5e9c50d47978fe9292'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.071376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1157/2302] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:14:04 2022] DELETE /identity/v3/users/33bbbac0dcd84e5e9c50d47978fe9292 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:05.075990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a266-35f0-4e2b-bf00-6cf8f46901ea None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:05.076328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a266-35f0-4e2b-bf00-6cf8f46901ea None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:05.076681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a266-35f0-4e2b-bf00-6cf8f46901ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:05.096628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2ce2a266-35f0-4e2b-bf00-6cf8f46901ea None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:05.098113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2ce2a266-35f0-4e2b-bf00-6cf8f46901ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:05.159673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1146/2303] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:14:05.169744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:05.171397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:05.236307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574240d6-4fa1-4355-a934-565b5d087d4b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:05.241106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3ab43-cb2d-4abd-a94d-43f33a2a913d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:05.241764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3ab43-cb2d-4abd-a94d-43f33a2a913d service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:05.242085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3ab43-cb2d-4abd-a94d-43f33a2a913d service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:05.242351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3ab43-cb2d-4abd-a94d-43f33a2a913d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:05.252161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3ab43-cb2d-4abd-a94d-43f33a2a913d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:05.253597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3ab43-cb2d-4abd-a94d-43f33a2a913d service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:05.263189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1158/2304] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:14:05.617683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2a266-35f0-4e2b-bf00-6cf8f46901ea None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:05.619192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2ce2a266-35f0-4e2b-bf00-6cf8f46901ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:05.638587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2a266-35f0-4e2b-bf00-6cf8f46901ea None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:05.647091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:05.660553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:05.660553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:05.660553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] PATH_INFO: `/v3/projects/f21a4ef5cd5d43a1bb3013bd441b41b0` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:05.660553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21a4ef5cd5d43a1bb3013bd441b41b0)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:05.661713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:05.720848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21a4ef5cd5d43a1bb3013bd441b41b0', 'request_id': 'req-5750cc63-f826-4093-9c8b-063db1b60a07'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.727455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21a4ef5cd5d43a1bb3013bd441b41b0', 'request_id': 'req-5750cc63-f826-4093-9c8b-063db1b60a07'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.735613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21a4ef5cd5d43a1bb3013bd441b41b0', 'request_id': 'req-5750cc63-f826-4093-9c8b-063db1b60a07'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.750107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] The token cache is being invalidate because project f21a4ef5cd5d43a1bb3013bd441b41b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:14:05.750401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.751020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-5750cc63-f826-4093-9c8b-063db1b60a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:05.752589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1147/2305] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:14:05 2022] DELETE /identity/v3/projects/f21a4ef5cd5d43a1bb3013bd441b41b0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:05.757769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c85a1d-e32d-4e7e-ae78-be993ce976de None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:05.758083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c85a1d-e32d-4e7e-ae78-be993ce976de None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:05.758357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c85a1d-e32d-4e7e-ae78-be993ce976de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:05.776813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-20c85a1d-e32d-4e7e-ae78-be993ce976de None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:05.778076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-20c85a1d-e32d-4e7e-ae78-be993ce976de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:05.795704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:05.842502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1159/2306] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:05.850540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d250df-6ec8-466c-a17f-041a5c487954 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:05.850819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d250df-6ec8-466c-a17f-041a5c487954 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:05.851098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d250df-6ec8-466c-a17f-041a5c487954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:05.869955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-79d250df-6ec8-466c-a17f-041a5c487954 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:05.871244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-79d250df-6ec8-466c-a17f-041a5c487954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:05.879497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1148/2307] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:14:05.884118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c85a1d-e32d-4e7e-ae78-be993ce976de None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:05.905550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c85a1d-e32d-4e7e-ae78-be993ce976de None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:05.912350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:05.913095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:05.913482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:05.913912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:05.914664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:14:05.915085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:05.916570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:05.933238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1160/2308] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:14:05.938061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d250df-6ec8-466c-a17f-041a5c487954 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:05.952659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d250df-6ec8-466c-a17f-041a5c487954 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:05.959956 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:05.960821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:05.961106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:05.961379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:05.962165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:05.964072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:05.997065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1149/2309] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:14:05 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:06.001196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:06.023550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55897409-8793-41f2-9f8c-30fbc025989e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:06.086594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045595-1e47-4b24-ba94-ca9fe437667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:06.087402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045595-1e47-4b24-ba94-ca9fe437667b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.087804 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045595-1e47-4b24-ba94-ca9fe437667b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.088760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045595-1e47-4b24-ba94-ca9fe437667b admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.088897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83045595-1e47-4b24-ba94-ca9fe437667b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:06.090973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83045595-1e47-4b24-ba94-ca9fe437667b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:06.098784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:06.103617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:06.113834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1161/2310] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:14:06 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:06.117158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871686-6662-4e84-a0df-7a9d442aa938 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:06.118613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045595-1e47-4b24-ba94-ca9fe437667b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:06.121918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:06.122905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.123091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.123540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] PATH_INFO: `/v3/users/94928e495cf44eb9894fa51f0f3538b3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.125045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94928e495cf44eb9894fa51f0f3538b3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:06.127014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:06.128621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045595-1e47-4b24-ba94-ca9fe437667b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:06.133442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea89f-2536-4e48-87c8-ca548ebab262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:06.134145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea89f-2536-4e48-87c8-ca548ebab262 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.134422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea89f-2536-4e48-87c8-ca548ebab262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.134694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea89f-2536-4e48-87c8-ca548ebab262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.135458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea89f-2536-4e48-87c8-ca548ebab262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:06.137097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea89f-2536-4e48-87c8-ca548ebab262 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:06.147700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1162/2311] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:14:06.151715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea89f-2536-4e48-87c8-ca548ebab262 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:06.163141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea89f-2536-4e48-87c8-ca548ebab262 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:06.168688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d5005-03e9-40f8-ae11-5ade71165938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:06.169362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5005-03e9-40f8-ae11-5ade71165938 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.169656 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5005-03e9-40f8-ae11-5ade71165938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.169971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d5005-03e9-40f8-ae11-5ade71165938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.170714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d5005-03e9-40f8-ae11-5ade71165938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:06.172435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d5005-03e9-40f8-ae11-5ade71165938 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:06.179421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94928e495cf44eb9894fa51f0f3538b3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:06.182327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:06.183989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1163/2312] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:06.188992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94928e495cf44eb9894fa51f0f3538b3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:06.189434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d5005-03e9-40f8-ae11-5ade71165938 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:06.200165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d5005-03e9-40f8-ae11-5ade71165938 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:06.202582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94928e495cf44eb9894fa51f0f3538b3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:06.204689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f230a-4fe6-47b5-b0f7-71efc3b7738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:06.205569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f230a-4fe6-47b5-b0f7-71efc3b7738a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.205881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f230a-4fe6-47b5-b0f7-71efc3b7738a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.206153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f230a-4fe6-47b5-b0f7-71efc3b7738a admin admin] PATH_INFO: `/v3/projects/e456e86229d84ae28c56cf25357f99bc/users/9a1e3a5739ac4a46beb0baa8887660f5/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.209757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94928e495cf44eb9894fa51f0f3538b3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:06.210703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-553e9934-6a3d-421c-a409-71c7e29fd987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94928e495cf44eb9894fa51f0f3538b3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:06.217150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1150/2313] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:14:06 2022] DELETE /identity/v3/users/94928e495cf44eb9894fa51f0f3538b3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:06.221625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65420f9-32f7-405c-96ac-438931cd87a1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.221948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65420f9-32f7-405c-96ac-438931cd87a1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.222113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f230a-4fe6-47b5-b0f7-71efc3b7738a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e456e86229d84ae28c56cf25357f99bc, user_id=9a1e3a5739ac4a46beb0baa8887660f5, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:06.222233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65420f9-32f7-405c-96ac-438931cd87a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.224782 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f230a-4fe6-47b5-b0f7-71efc3b7738a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:06.240148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1164/2314] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:06 2022] PUT /identity/v3/projects/e456e86229d84ae28c56cf25357f99bc/users/9a1e3a5739ac4a46beb0baa8887660f5/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:06.240805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b65420f9-32f7-405c-96ac-438931cd87a1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:06.242361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b65420f9-32f7-405c-96ac-438931cd87a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:06.245162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d69-6fb4-4a5b-bced-19050653a546 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.245522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d69-6fb4-4a5b-bced-19050653a546 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.246040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7d69-6fb4-4a5b-bced-19050653a546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.263128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3ebb7d69-6fb4-4a5b-bced-19050653a546 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:06.264521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3ebb7d69-6fb4-4a5b-bced-19050653a546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:06.321898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1151/2315] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:14:06.325052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:06.328981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65420f9-32f7-405c-96ac-438931cd87a1 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:06.330543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b65420f9-32f7-405c-96ac-438931cd87a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:06.343940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1165/2316] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:06.353649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7d69-6fb4-4a5b-bced-19050653a546 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:06.355110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3ebb7d69-6fb4-4a5b-bced-19050653a546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:06.407673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65420f9-32f7-405c-96ac-438931cd87a1 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:06.411463 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:06.412126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.412625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.412954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.417848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7d69-6fb4-4a5b-bced-19050653a546 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:06.421609 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d508e58-ab08-4ff7-acab-a0b422e51ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:06.422296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d508e58-ab08-4ff7-acab-a0b422e51ebb service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:06.422737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d508e58-ab08-4ff7-acab-a0b422e51ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:06.423356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:06.423542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d508e58-ab08-4ff7-acab-a0b422e51ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:06.424831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:06.438254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d508e58-ab08-4ff7-acab-a0b422e51ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:06.439783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d508e58-ab08-4ff7-acab-a0b422e51ebb service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:06.444121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1152/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:14:06.453566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1166/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:14:07.122539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:07.125959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:07.154271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4dfcd-5fa3-428a-aacb-1570344b152a service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:07.166879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:07.169283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:07.171288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:07.171742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] PATH_INFO: `/v3/projects/88d99f01f94140cfbf7e55ccb7b1442e` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:07.188868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d99f01f94140cfbf7e55ccb7b1442e)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:07.193149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:07.309325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d99f01f94140cfbf7e55ccb7b1442e', 'request_id': 'req-70e6f918-84a5-44a6-a356-0c7227c4320f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.317617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d99f01f94140cfbf7e55ccb7b1442e', 'request_id': 'req-70e6f918-84a5-44a6-a356-0c7227c4320f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.326112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d99f01f94140cfbf7e55ccb7b1442e', 'request_id': 'req-70e6f918-84a5-44a6-a356-0c7227c4320f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.332489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:07.359242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] The token cache is being invalidate because project 88d99f01f94140cfbf7e55ccb7b1442e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:14:07.359777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.361442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.366435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1153/2319] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:14:07 2022] DELETE /identity/v3/projects/88d99f01f94140cfbf7e55ccb7b1442e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:07.371067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d508e58-ab08-4ff7-acab-a0b422e51ebb service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:07.397658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d508e58-ab08-4ff7-acab-a0b422e51ebb service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:07.495061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:07.496207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:07.496557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:07.496898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] PATH_INFO: `/v3/users/72156ee2573f47e5bb4f7bfe17a2c465` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:07.498284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=72156ee2573f47e5bb4f7bfe17a2c465)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:07.500555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:07.572430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72156ee2573f47e5bb4f7bfe17a2c465'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.573160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72156ee2573f47e5bb4f7bfe17a2c465'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.583969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72156ee2573f47e5bb4f7bfe17a2c465'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.595055 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72156ee2573f47e5bb4f7bfe17a2c465'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.615571 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ade2fc21-12e6-4bcf-94a6-df1ceb08aefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72156ee2573f47e5bb4f7bfe17a2c465'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:07.626340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1167/2320] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:14:07 2022] DELETE /identity/v3/users/72156ee2573f47e5bb4f7bfe17a2c465 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:07.932009 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:07.933619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:07.965393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6f918-84a5-44a6-a356-0c7227c4320f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:08.031365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:08.032354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.032644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.032916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] PATH_INFO: `/v3/projects/ce2245a47bf54de0a4264e247abd8daa` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.034175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2245a47bf54de0a4264e247abd8daa)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:08.036164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:08.098812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2245a47bf54de0a4264e247abd8daa', 'request_id': 'req-74d47880-2dbe-4992-9c58-5f722fde627f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:08.110248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2245a47bf54de0a4264e247abd8daa', 'request_id': 'req-74d47880-2dbe-4992-9c58-5f722fde627f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:08.121280 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2245a47bf54de0a4264e247abd8daa', 'request_id': 'req-74d47880-2dbe-4992-9c58-5f722fde627f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:08.140339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] The token cache is being invalidate because project ce2245a47bf54de0a4264e247abd8daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:14:08.140934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:08.141383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-74d47880-2dbe-4992-9c58-5f722fde627f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:08.144637 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1154/2321] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:14:07 2022] DELETE /identity/v3/projects/ce2245a47bf54de0a4264e247abd8daa => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:08.148728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08341e-5a7b-4daf-810a-62cf161341af None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.149159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08341e-5a7b-4daf-810a-62cf161341af None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.149611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08341e-5a7b-4daf-810a-62cf161341af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.177014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2b08341e-5a7b-4daf-810a-62cf161341af None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:08.178339 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2b08341e-5a7b-4daf-810a-62cf161341af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:08.222503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:08.292264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1168/2322] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:14:08.301151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452078b-3a90-4313-9564-e7f822588f99 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.301702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452078b-3a90-4313-9564-e7f822588f99 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.302169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452078b-3a90-4313-9564-e7f822588f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.323903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b452078b-3a90-4313-9564-e7f822588f99 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:08.325424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b452078b-3a90-4313-9564-e7f822588f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:08.334984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1155/2323] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:08.339824 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08341e-5a7b-4daf-810a-62cf161341af None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:08.351557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08341e-5a7b-4daf-810a-62cf161341af None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:08.357579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:08.358505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.359082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.359721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.367380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:14:08.368021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:08.370000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:08.386763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1169/2324] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:14:08.388729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452078b-3a90-4313-9564-e7f822588f99 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:08.403069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452078b-3a90-4313-9564-e7f822588f99 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:08.408608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db4fc5-22aa-42b9-af16-e3f45f3106f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:08.409463 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db4fc5-22aa-42b9-af16-e3f45f3106f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.409918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db4fc5-22aa-42b9-af16-e3f45f3106f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.410378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db4fc5-22aa-42b9-af16-e3f45f3106f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.411354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db4fc5-22aa-42b9-af16-e3f45f3106f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:08.413501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db4fc5-22aa-42b9-af16-e3f45f3106f1 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:08.456220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1156/2325] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:14:08 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:08.456716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:08.469902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff7ad-823e-4e00-bf11-70e5b2cadbc0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:08.590222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc532-88aa-49bc-a5cc-2e8c8ba33d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:08.590915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc532-88aa-49bc-a5cc-2e8c8ba33d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.591198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc532-88aa-49bc-a5cc-2e8c8ba33d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.591584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cc532-88aa-49bc-a5cc-2e8c8ba33d17 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.592505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cc532-88aa-49bc-a5cc-2e8c8ba33d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:08.594475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cc532-88aa-49bc-a5cc-2e8c8ba33d17 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:08.621854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1170/2326] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:14:08 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:14:08.624658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db4fc5-22aa-42b9-af16-e3f45f3106f1 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:08.642901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db4fc5-22aa-42b9-af16-e3f45f3106f1 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:08.648340 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4eff-5732-4fcd-9d64-682e5e15b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:08.649567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4eff-5732-4fcd-9d64-682e5e15b73c admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.650010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4eff-5732-4fcd-9d64-682e5e15b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.650605 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b4eff-5732-4fcd-9d64-682e5e15b73c admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.652675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b4eff-5732-4fcd-9d64-682e5e15b73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:08.654466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b4eff-5732-4fcd-9d64-682e5e15b73c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:08.675746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1157/2327] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:08.677015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc532-88aa-49bc-a5cc-2e8c8ba33d17 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:08.701246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cc532-88aa-49bc-a5cc-2e8c8ba33d17 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:08.708569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4812eb-8961-4d2f-9caf-aadb47047329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:08.709260 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4812eb-8961-4d2f-9caf-aadb47047329 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.709604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4812eb-8961-4d2f-9caf-aadb47047329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.709954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4812eb-8961-4d2f-9caf-aadb47047329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.710845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4812eb-8961-4d2f-9caf-aadb47047329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:08.712421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4812eb-8961-4d2f-9caf-aadb47047329 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:08.729931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1171/2328] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:08.732888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4eff-5732-4fcd-9d64-682e5e15b73c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:08.746173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b4eff-5732-4fcd-9d64-682e5e15b73c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:08.751922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852441-880a-4acd-8215-efdadfdd4578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:08.752825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852441-880a-4acd-8215-efdadfdd4578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.753108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852441-880a-4acd-8215-efdadfdd4578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.753389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852441-880a-4acd-8215-efdadfdd4578 admin admin] PATH_INFO: `/v3/projects/af18d3afe2e24d249bd4656e0e29545c/users/43f1105ad69e47f881b5e40638afc53b/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.774200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea852441-880a-4acd-8215-efdadfdd4578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af18d3afe2e24d249bd4656e0e29545c, user_id=43f1105ad69e47f881b5e40638afc53b, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:08.777910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea852441-880a-4acd-8215-efdadfdd4578 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:08.817609 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1158/2329] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:08 2022] PUT /identity/v3/projects/af18d3afe2e24d249bd4656e0e29545c/users/43f1105ad69e47f881b5e40638afc53b/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:08.823345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46878-d2bd-43e8-bf30-f7db3b6ee85f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:08.823797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46878-d2bd-43e8-bf30-f7db3b6ee85f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:08.824298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46878-d2bd-43e8-bf30-f7db3b6ee85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:08.855434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aec46878-d2bd-43e8-bf30-f7db3b6ee85f None None] MFA Rules not processed for user `43f1105ad69e47f881b5e40638afc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:08.856667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aec46878-d2bd-43e8-bf30-f7db3b6ee85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:08.929180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1172/2330] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:08.933862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852441-880a-4acd-8215-efdadfdd4578 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:08.958021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:09.050677 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852441-880a-4acd-8215-efdadfdd4578 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:09.058203 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362f790-e543-4420-b44a-6c83a0ced681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:09.059113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f790-e543-4420-b44a-6c83a0ced681 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:09.059685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f790-e543-4420-b44a-6c83a0ced681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:09.059826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362f790-e543-4420-b44a-6c83a0ced681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:09.060591 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362f790-e543-4420-b44a-6c83a0ced681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:09.063676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362f790-e543-4420-b44a-6c83a0ced681 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:09.100109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1159/2331] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:14:08 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:09.101666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec46878-d2bd-43e8-bf30-f7db3b6ee85f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:09.116876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec46878-d2bd-43e8-bf30-f7db3b6ee85f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:09.147655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:09.237024 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74faf8e-ed11-44f5-9d02-7f6b775dae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:09.237871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74faf8e-ed11-44f5-9d02-7f6b775dae47 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:09.238211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74faf8e-ed11-44f5-9d02-7f6b775dae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:09.238708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74faf8e-ed11-44f5-9d02-7f6b775dae47 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:09.239557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74faf8e-ed11-44f5-9d02-7f6b775dae47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:09.241621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74faf8e-ed11-44f5-9d02-7f6b775dae47 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:09.268078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1173/2332] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:14:09 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:09.272048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362f790-e543-4420-b44a-6c83a0ced681 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:09.288985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362f790-e543-4420-b44a-6c83a0ced681 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:09.295520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcac9a9-b84d-4bd9-b5fe-9c2dbef11b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:09.296440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcac9a9-b84d-4bd9-b5fe-9c2dbef11b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:09.296903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcac9a9-b84d-4bd9-b5fe-9c2dbef11b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:09.297346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcac9a9-b84d-4bd9-b5fe-9c2dbef11b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:09.298288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcac9a9-b84d-4bd9-b5fe-9c2dbef11b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:09.300077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcac9a9-b84d-4bd9-b5fe-9c2dbef11b56 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:09.314627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1160/2333] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:09.319118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74faf8e-ed11-44f5-9d02-7f6b775dae47 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:09.330516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74faf8e-ed11-44f5-9d02-7f6b775dae47 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:09.336302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a5b3-7cc9-47f0-a9d1-526d1fcb9c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:09.337057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a5b3-7cc9-47f0-a9d1-526d1fcb9c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:09.337429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a5b3-7cc9-47f0-a9d1-526d1fcb9c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:09.337828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a5b3-7cc9-47f0-a9d1-526d1fcb9c6c admin admin] PATH_INFO: `/v3/projects/2688e76f2bfe449fb60066a5aacf1052/users/81cd9858365442afa5728d10b3938a3c/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:09.360031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a5b3-7cc9-47f0-a9d1-526d1fcb9c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2688e76f2bfe449fb60066a5aacf1052, user_id=81cd9858365442afa5728d10b3938a3c, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:09.363292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a5b3-7cc9-47f0-a9d1-526d1fcb9c6c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:09.383907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1174/2334] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:09 2022] PUT /identity/v3/projects/2688e76f2bfe449fb60066a5aacf1052/users/81cd9858365442afa5728d10b3938a3c/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:09.389780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcac9a9-b84d-4bd9-b5fe-9c2dbef11b56 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:09.404379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcac9a9-b84d-4bd9-b5fe-9c2dbef11b56 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:09.487914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44690286-e974-4cfe-902e-bb9fb766085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:09.489184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690286-e974-4cfe-902e-bb9fb766085c admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:09.489571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690286-e974-4cfe-902e-bb9fb766085c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:09.490461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690286-e974-4cfe-902e-bb9fb766085c admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:09.492756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44690286-e974-4cfe-902e-bb9fb766085c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:09.494770 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44690286-e974-4cfe-902e-bb9fb766085c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:09.508529 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1161/2335] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:14:09.512913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a5b3-7cc9-47f0-a9d1-526d1fcb9c6c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:09.548436 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a5b3-7cc9-47f0-a9d1-526d1fcb9c6c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:09.556257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:09.557515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:09.557982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:09.558433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] PATH_INFO: `/v3/projects/2688e76f2bfe449fb60066a5aacf1052/users/81cd9858365442afa5728d10b3938a3c/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:09.560950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2688e76f2bfe449fb60066a5aacf1052, user_id=81cd9858365442afa5728d10b3938a3c, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:09.565042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:09.580938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1175/2336] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:09 2022] PUT /identity/v3/projects/2688e76f2bfe449fb60066a5aacf1052/users/81cd9858365442afa5728d10b3938a3c/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:14:09.591949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7301d-7996-4c9d-ac39-76d724047d02 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:09.592472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7301d-7996-4c9d-ac39-76d724047d02 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:09.592573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7301d-7996-4c9d-ac39-76d724047d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:09.635810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d8a7301d-7996-4c9d-ac39-76d724047d02 None None] MFA Rules not processed for user `81cd9858365442afa5728d10b3938a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:09.636974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d8a7301d-7996-4c9d-ac39-76d724047d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:09.743691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1162/2337] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:09.755690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:09.759082 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:09.847786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef879a91-7c76-46f3-a751-72c46f1a462c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:09.853871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:09.854580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:09.854860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:09.855263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:09.921758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:09.923768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:09.936106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1176/2338] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:14:12.124787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f40cb-d11d-4c6b-b120-69b27cfef745 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:12.125316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f40cb-d11d-4c6b-b120-69b27cfef745 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:12.125316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f40cb-d11d-4c6b-b120-69b27cfef745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:12.184623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-634f40cb-d11d-4c6b-b120-69b27cfef745 None None] MFA Rules not processed for user `9a1e3a5739ac4a46beb0baa8887660f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:12.186012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-634f40cb-d11d-4c6b-b120-69b27cfef745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:12.191210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:12.283913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1163/2339] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:12.289008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:12.290642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:12.314781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:12.363994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0601b-a8aa-4df6-a7e6-dea94537546c service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:12.369648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8faae3-1ba0-42b3-b884-6a16452b1c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:12.370367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8faae3-1ba0-42b3-b884-6a16452b1c74 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:12.370676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8faae3-1ba0-42b3-b884-6a16452b1c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:12.370959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8faae3-1ba0-42b3-b884-6a16452b1c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:12.371667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8faae3-1ba0-42b3-b884-6a16452b1c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:12.373671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8faae3-1ba0-42b3-b884-6a16452b1c74 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:12.404223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1177/2340] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:14:12 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:14:12.408419 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f40cb-d11d-4c6b-b120-69b27cfef745 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:12.420568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f40cb-d11d-4c6b-b120-69b27cfef745 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:12.501975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dc9bf-5947-410e-bc0b-adb92a97e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:12.503200 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dc9bf-5947-410e-bc0b-adb92a97e06c admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:12.503853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dc9bf-5947-410e-bc0b-adb92a97e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:12.504150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dc9bf-5947-410e-bc0b-adb92a97e06c admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:12.506800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dc9bf-5947-410e-bc0b-adb92a97e06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:12.509337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dc9bf-5947-410e-bc0b-adb92a97e06c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:12.553840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1164/2341] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:14:12 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:12.556482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8faae3-1ba0-42b3-b884-6a16452b1c74 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:12.575990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8faae3-1ba0-42b3-b884-6a16452b1c74 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:12.589420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f857-d07c-4b68-94c1-03017f55cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:12.592052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f857-d07c-4b68-94c1-03017f55cbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:12.596834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f857-d07c-4b68-94c1-03017f55cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:12.596834 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f857-d07c-4b68-94c1-03017f55cbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:12.597629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f857-d07c-4b68-94c1-03017f55cbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:12.601272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f857-d07c-4b68-94c1-03017f55cbb1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:12.637342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1178/2342] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:12.641327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dc9bf-5947-410e-bc0b-adb92a97e06c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:12.663322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dc9bf-5947-410e-bc0b-adb92a97e06c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:12.669977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1c6f-dfb0-4924-b1d5-4eb9a9e7317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:12.670903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1c6f-dfb0-4924-b1d5-4eb9a9e7317f admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:12.671288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1c6f-dfb0-4924-b1d5-4eb9a9e7317f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:12.671455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1c6f-dfb0-4924-b1d5-4eb9a9e7317f admin admin] PATH_INFO: `/v3/projects/3dbf727359934d70ac5bfb0a647205a0/users/639ee8a0c5224dfcba5ff5bef4d1c085/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:12.689656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae1c6f-dfb0-4924-b1d5-4eb9a9e7317f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbf727359934d70ac5bfb0a647205a0, user_id=639ee8a0c5224dfcba5ff5bef4d1c085, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:12.692600 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae1c6f-dfb0-4924-b1d5-4eb9a9e7317f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:12.713345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1165/2343] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:12 2022] PUT /identity/v3/projects/3dbf727359934d70ac5bfb0a647205a0/users/639ee8a0c5224dfcba5ff5bef4d1c085/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:12.717306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f857-d07c-4b68-94c1-03017f55cbb1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:12.733265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f857-d07c-4b68-94c1-03017f55cbb1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:12.798661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:12.799340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:12.799653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:12.799923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:12.800653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:12.802284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:12.814189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1179/2344] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:14:12.818300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1c6f-dfb0-4924-b1d5-4eb9a9e7317f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:12.830333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1c6f-dfb0-4924-b1d5-4eb9a9e7317f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:12.835746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb3ccc-b71b-46e7-bdd7-e7030a6a7216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:12.836693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3ccc-b71b-46e7-bdd7-e7030a6a7216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:12.836981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3ccc-b71b-46e7-bdd7-e7030a6a7216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:12.837256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3ccc-b71b-46e7-bdd7-e7030a6a7216 admin admin] PATH_INFO: `/v3/projects/3dbf727359934d70ac5bfb0a647205a0/users/639ee8a0c5224dfcba5ff5bef4d1c085/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:12.839298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb3ccc-b71b-46e7-bdd7-e7030a6a7216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbf727359934d70ac5bfb0a647205a0, user_id=639ee8a0c5224dfcba5ff5bef4d1c085, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:12.842037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb3ccc-b71b-46e7-bdd7-e7030a6a7216 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:12.858531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1166/2345] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:12 2022] PUT /identity/v3/projects/3dbf727359934d70ac5bfb0a647205a0/users/639ee8a0c5224dfcba5ff5bef4d1c085/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:18.754450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:18.758758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:18.786425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6ca51-99c1-40ad-82d6-9cb8b98e2be2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:18.851846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:18.852861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:18.853154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:18.853714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] PATH_INFO: `/v3/users/ac2a3db386b548a593f69f7be18825a0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:18.855247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2a3db386b548a593f69f7be18825a0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:18.857758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:18.915432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:18.931453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2a3db386b548a593f69f7be18825a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:18.932131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2a3db386b548a593f69f7be18825a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:18.941289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2a3db386b548a593f69f7be18825a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:18.950329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2a3db386b548a593f69f7be18825a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:18.966187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2a3db386b548a593f69f7be18825a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:18.984441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1180/2346] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:14:18 2022] DELETE /identity/v3/users/ac2a3db386b548a593f69f7be18825a0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:18.986053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efc7bd-04fc-4e47-a162-604720ae00bc None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:18.986564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efc7bd-04fc-4e47-a162-604720ae00bc None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:18.986666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efc7bd-04fc-4e47-a162-604720ae00bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:19.025622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-70efc7bd-04fc-4e47-a162-604720ae00bc None None] MFA Rules not processed for user `639ee8a0c5224dfcba5ff5bef4d1c085`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:19.026903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-70efc7bd-04fc-4e47-a162-604720ae00bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:19.098748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:19.144415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1167/2347] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:19.157242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:19.161937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:19.273819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2a956-ca82-43a9-91ec-5d4319a861b9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:19.285766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:19.291213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:19.292203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:19.292665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:19.295326 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:19.313472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efc7bd-04fc-4e47-a162-604720ae00bc None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:19.314974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-70efc7bd-04fc-4e47-a162-604720ae00bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:19.398931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:19.400635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:19.422384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efc7bd-04fc-4e47-a162-604720ae00bc None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:19.427193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1181/2348] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:14:19.428063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:19.428982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:19.429266 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:19.429543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] PATH_INFO: `/v3/projects/f275cde4f8184f0b850590f597e921a4` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:19.431032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f275cde4f8184f0b850590f597e921a4)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:19.433290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:19.516612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f275cde4f8184f0b850590f597e921a4', 'request_id': 'req-4187a10d-713c-4e29-8c60-d891bcffe8c7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.526392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f275cde4f8184f0b850590f597e921a4', 'request_id': 'req-4187a10d-713c-4e29-8c60-d891bcffe8c7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.534851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f275cde4f8184f0b850590f597e921a4', 'request_id': 'req-4187a10d-713c-4e29-8c60-d891bcffe8c7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.558297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] The token cache is being invalidate because project f275cde4f8184f0b850590f597e921a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:14:19.558739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.559906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.562547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1168/2349] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:14:19 2022] DELETE /identity/v3/projects/f275cde4f8184f0b850590f597e921a4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:14:19.566816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:19.580729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c007a-648c-40b7-a1da-6e3b7418844d service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:19.656488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:19.682007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:19.682944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:19.683610 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:19.684214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] PATH_INFO: `/v3/users/f2ae88fffc354e7d8d58f50c7383608c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:19.686006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ae88fffc354e7d8d58f50c7383608c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:19.688419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:19.754922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ae88fffc354e7d8d58f50c7383608c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.756365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ae88fffc354e7d8d58f50c7383608c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.768692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ae88fffc354e7d8d58f50c7383608c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.779170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ae88fffc354e7d8d58f50c7383608c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.807383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d6650261-dbd5-409e-99cd-628a3cfb17d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ae88fffc354e7d8d58f50c7383608c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:19.816673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1182/2350] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:14:19 2022] DELETE /identity/v3/users/f2ae88fffc354e7d8d58f50c7383608c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:20.083425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:20.086690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:20.108210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187a10d-713c-4e29-8c60-d891bcffe8c7 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:20.194856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:20.195946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.196230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.196504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] PATH_INFO: `/v3/projects/6df1cc7111d34e52824af8049b74e98b` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.197721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df1cc7111d34e52824af8049b74e98b)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:20.199879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:20.217214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:20.258703 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df1cc7111d34e52824af8049b74e98b', 'request_id': 'req-52f07a58-a61b-4503-a7df-ef2d023338e2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:20.266407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df1cc7111d34e52824af8049b74e98b', 'request_id': 'req-52f07a58-a61b-4503-a7df-ef2d023338e2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:20.280654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df1cc7111d34e52824af8049b74e98b', 'request_id': 'req-52f07a58-a61b-4503-a7df-ef2d023338e2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:20.301197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] The token cache is being invalidate because project 6df1cc7111d34e52824af8049b74e98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:14:20.301514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:20.302145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-52f07a58-a61b-4503-a7df-ef2d023338e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:20.307649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1169/2351] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:14:20 2022] DELETE /identity/v3/projects/6df1cc7111d34e52824af8049b74e98b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:20.314862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253402b2-3be1-4cb3-b782-e42801e5edef None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.314862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253402b2-3be1-4cb3-b782-e42801e5edef None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.314862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253402b2-3be1-4cb3-b782-e42801e5edef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.333040 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-253402b2-3be1-4cb3-b782-e42801e5edef None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:20.334444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-253402b2-3be1-4cb3-b782-e42801e5edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:20.402513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1183/2352] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:20.410668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96adf3-1fc9-46ee-ad4b-22c328e60a74 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.411100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96adf3-1fc9-46ee-ad4b-22c328e60a74 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.411211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96adf3-1fc9-46ee-ad4b-22c328e60a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.432585 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-3e96adf3-1fc9-46ee-ad4b-22c328e60a74 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:20.434218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-3e96adf3-1fc9-46ee-ad4b-22c328e60a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:20.445233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1170/2353] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:14:20.449829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253402b2-3be1-4cb3-b782-e42801e5edef None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:20.462558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253402b2-3be1-4cb3-b782-e42801e5edef None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:20.468467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:20.469321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.469616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.469948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.470750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:14:20.471235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:20.473524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:20.489149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1184/2354] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:14:20.494483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96adf3-1fc9-46ee-ad4b-22c328e60a74 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:20.508044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96adf3-1fc9-46ee-ad4b-22c328e60a74 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:20.514241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cbdc7-685a-4e1c-bff3-921ed34ea809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:20.515083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cbdc7-685a-4e1c-bff3-921ed34ea809 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.515538 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cbdc7-685a-4e1c-bff3-921ed34ea809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.515881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cbdc7-685a-4e1c-bff3-921ed34ea809 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.516764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cbdc7-685a-4e1c-bff3-921ed34ea809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:20.519396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cbdc7-685a-4e1c-bff3-921ed34ea809 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:20.562440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1171/2355] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:14:20 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:20.567592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:20.590718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca831e1-f4d2-4c59-871c-aa9d5901610f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:20.662410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:20.682006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba6d95-68b2-4714-8462-cfd77b5ad958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:20.682753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6d95-68b2-4714-8462-cfd77b5ad958 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.683035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6d95-68b2-4714-8462-cfd77b5ad958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.683305 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba6d95-68b2-4714-8462-cfd77b5ad958 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.684219 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba6d95-68b2-4714-8462-cfd77b5ad958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:20.686209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba6d95-68b2-4714-8462-cfd77b5ad958 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:20.718032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1185/2356] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:14:20 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:20.719955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cbdc7-685a-4e1c-bff3-921ed34ea809 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:20.731145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cbdc7-685a-4e1c-bff3-921ed34ea809 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:20.735890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838c128-1a00-4919-ab29-f745264ebcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:20.736616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c128-1a00-4919-ab29-f745264ebcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.736925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c128-1a00-4919-ab29-f745264ebcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.737184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c128-1a00-4919-ab29-f745264ebcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.737964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838c128-1a00-4919-ab29-f745264ebcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:20.739567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838c128-1a00-4919-ab29-f745264ebcf3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:20.752017 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1172/2357] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:20.755868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba6d95-68b2-4714-8462-cfd77b5ad958 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:20.767725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba6d95-68b2-4714-8462-cfd77b5ad958 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:20.774402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc93d3-832c-42c6-90d7-b5931541afe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:20.775225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc93d3-832c-42c6-90d7-b5931541afe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.775569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc93d3-832c-42c6-90d7-b5931541afe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.775908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc93d3-832c-42c6-90d7-b5931541afe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.776708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc93d3-832c-42c6-90d7-b5931541afe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:20.778586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc93d3-832c-42c6-90d7-b5931541afe2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:20.789856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1186/2358] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:20.794235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838c128-1a00-4919-ab29-f745264ebcf3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:20.804996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838c128-1a00-4919-ab29-f745264ebcf3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:20.810708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40277492-9ac8-4c5f-9da9-7e41397bd424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:20.811996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277492-9ac8-4c5f-9da9-7e41397bd424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.812294 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277492-9ac8-4c5f-9da9-7e41397bd424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.812533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277492-9ac8-4c5f-9da9-7e41397bd424 admin admin] PATH_INFO: `/v3/projects/82dfe3ca0433478f817d062ec5557f75/users/5f734f2e317c4c99b2dc288e171add40/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.828165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40277492-9ac8-4c5f-9da9-7e41397bd424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82dfe3ca0433478f817d062ec5557f75, user_id=5f734f2e317c4c99b2dc288e171add40, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:20.831059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40277492-9ac8-4c5f-9da9-7e41397bd424 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:20.848005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1173/2359] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:20 2022] PUT /identity/v3/projects/82dfe3ca0433478f817d062ec5557f75/users/5f734f2e317c4c99b2dc288e171add40/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:20.859327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc4cb-4e74-4ea2-a30f-69acc3bd9734 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.859646 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc4cb-4e74-4ea2-a30f-69acc3bd9734 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.860349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dc4cb-4e74-4ea2-a30f-69acc3bd9734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.891908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a93dc4cb-4e74-4ea2-a30f-69acc3bd9734 None None] MFA Rules not processed for user `5f734f2e317c4c99b2dc288e171add40`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:20.893601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a93dc4cb-4e74-4ea2-a30f-69acc3bd9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:20.951159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3b3f-eb27-4969-8394-546e011c8b90 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:20.951950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3b3f-eb27-4969-8394-546e011c8b90 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:20.952234 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3b3f-eb27-4969-8394-546e011c8b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:20.972805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a55b3b3f-eb27-4969-8394-546e011c8b90 None None] MFA Rules not processed for user `9a1e3a5739ac4a46beb0baa8887660f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:20.974156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a55b3b3f-eb27-4969-8394-546e011c8b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:20.981803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1187/2360] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:20.986262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dc4cb-4e74-4ea2-a30f-69acc3bd9734 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:21.041837 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1174/2361] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:21.061174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dc4cb-4e74-4ea2-a30f-69acc3bd9734 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:21.066161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114de4-f1a9-41d1-9797-2ba4cf3235c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:21.066864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114de4-f1a9-41d1-9797-2ba4cf3235c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:21.067848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114de4-f1a9-41d1-9797-2ba4cf3235c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:21.068131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114de4-f1a9-41d1-9797-2ba4cf3235c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:21.068946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb114de4-f1a9-41d1-9797-2ba4cf3235c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:21.070924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb114de4-f1a9-41d1-9797-2ba4cf3235c5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:21.100828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1188/2362] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:14:20 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:14:21.105117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b3b3f-eb27-4969-8394-546e011c8b90 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:21.117721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b3b3f-eb27-4969-8394-546e011c8b90 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:21.171002 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:21.193970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98c52e-8b56-4c51-b874-3fc0814d12e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:21.193970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c52e-8b56-4c51-b874-3fc0814d12e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:21.193970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c52e-8b56-4c51-b874-3fc0814d12e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:21.193970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c52e-8b56-4c51-b874-3fc0814d12e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:21.194716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98c52e-8b56-4c51-b874-3fc0814d12e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:21.196710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98c52e-8b56-4c51-b874-3fc0814d12e5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:21.222671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1175/2363] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:14:21 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:14:21.223872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114de4-f1a9-41d1-9797-2ba4cf3235c5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:21.235019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114de4-f1a9-41d1-9797-2ba4cf3235c5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:21.240447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2845cf6-ae19-4e3e-8649-265f2aa8d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:21.241197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845cf6-ae19-4e3e-8649-265f2aa8d9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:21.241537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845cf6-ae19-4e3e-8649-265f2aa8d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:21.241836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845cf6-ae19-4e3e-8649-265f2aa8d9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:21.242575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2845cf6-ae19-4e3e-8649-265f2aa8d9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:21.244196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2845cf6-ae19-4e3e-8649-265f2aa8d9ad admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:21.261037 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1189/2364] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:21.265362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98c52e-8b56-4c51-b874-3fc0814d12e5 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:21.279284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98c52e-8b56-4c51-b874-3fc0814d12e5 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:21.284656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262800-edc4-48ee-97d4-8e49012507b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:21.285747 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262800-edc4-48ee-97d4-8e49012507b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:21.286071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262800-edc4-48ee-97d4-8e49012507b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:21.286477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262800-edc4-48ee-97d4-8e49012507b4 admin admin] PATH_INFO: `/v3/projects/abbc1966d172468b9cdf3dbc6bebde75/users/4191a25eba2747788632caf64246d024/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:21.308822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03262800-edc4-48ee-97d4-8e49012507b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbc1966d172468b9cdf3dbc6bebde75, user_id=4191a25eba2747788632caf64246d024, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:21.312072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03262800-edc4-48ee-97d4-8e49012507b4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:21.330524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1176/2365] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:21 2022] PUT /identity/v3/projects/abbc1966d172468b9cdf3dbc6bebde75/users/4191a25eba2747788632caf64246d024/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:21.335065 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2845cf6-ae19-4e3e-8649-265f2aa8d9ad admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:21.348109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2845cf6-ae19-4e3e-8649-265f2aa8d9ad admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:21.382724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:21.411463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc06eac-dca1-487d-9b72-d3ad90d6b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:21.412210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06eac-dca1-487d-9b72-d3ad90d6b2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:21.412642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06eac-dca1-487d-9b72-d3ad90d6b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:21.412959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06eac-dca1-487d-9b72-d3ad90d6b2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:21.413763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc06eac-dca1-487d-9b72-d3ad90d6b2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:21.416060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc06eac-dca1-487d-9b72-d3ad90d6b2f2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:21.428880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1190/2366] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:14:21.433671 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262800-edc4-48ee-97d4-8e49012507b4 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:21.445370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262800-edc4-48ee-97d4-8e49012507b4 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:21.468407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:21.469423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:21.469771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:21.470145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] PATH_INFO: `/v3/projects/abbc1966d172468b9cdf3dbc6bebde75/users/4191a25eba2747788632caf64246d024/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:21.472255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbc1966d172468b9cdf3dbc6bebde75, user_id=4191a25eba2747788632caf64246d024, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:21.475078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:21.492852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1177/2367] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:14:21 2022] PUT /identity/v3/projects/abbc1966d172468b9cdf3dbc6bebde75/users/4191a25eba2747788632caf64246d024/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:21.504176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b99fc-506d-4816-9c38-bc50d1cecd5e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:21.504464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b99fc-506d-4816-9c38-bc50d1cecd5e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:21.504740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b99fc-506d-4816-9c38-bc50d1cecd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:21.545384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1c1b99fc-506d-4816-9c38-bc50d1cecd5e None None] MFA Rules not processed for user `4191a25eba2747788632caf64246d024`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:21.546955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1c1b99fc-506d-4816-9c38-bc50d1cecd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:21.629415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1191/2368] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:21.640233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:21.642048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:21.724302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a121c1-1cc9-4993-a59d-27c6f6070260 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:21.728913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09b52d-c47d-4628-8ca3-8ccdab6fe46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:21.729590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b52d-c47d-4628-8ca3-8ccdab6fe46e service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:21.729919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b52d-c47d-4628-8ca3-8ccdab6fe46e service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:21.730205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b52d-c47d-4628-8ca3-8ccdab6fe46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:21.797444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09b52d-c47d-4628-8ca3-8ccdab6fe46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:21.799166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09b52d-c47d-4628-8ca3-8ccdab6fe46e service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:21.810006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1178/2369] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:14:22.624623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b99fc-506d-4816-9c38-bc50d1cecd5e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:22.626163 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1c1b99fc-506d-4816-9c38-bc50d1cecd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:22.638695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b99fc-506d-4816-9c38-bc50d1cecd5e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:22.642575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c15e1-86a1-4d98-92f8-af978e257462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:22.643218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c15e1-86a1-4d98-92f8-af978e257462 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:22.643519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c15e1-86a1-4d98-92f8-af978e257462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:22.643772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c15e1-86a1-4d98-92f8-af978e257462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:22.645560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-606c15e1-86a1-4d98-92f8-af978e257462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:22.712670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c15e1-86a1-4d98-92f8-af978e257462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:22.714197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c15e1-86a1-4d98-92f8-af978e257462 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:22.728206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1192/2370] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:14:31.809959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=72,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:32.721099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=78 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:44.117989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09b52d-c47d-4628-8ca3-8ccdab6fe46e service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:44.140547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09b52d-c47d-4628-8ca3-8ccdab6fe46e service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:44.144796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:44.145507 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:44.145809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:44.146107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:44.181504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:44.183054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:44.195272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1179/2371] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:14:53.545371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6636e-941a-44d9-9abd-e1d27d3508a6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:53.545888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6636e-941a-44d9-9abd-e1d27d3508a6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:53.545984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6636e-941a-44d9-9abd-e1d27d3508a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:53.588054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5ff6636e-941a-44d9-9abd-e1d27d3508a6 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:53.589284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5ff6636e-941a-44d9-9abd-e1d27d3508a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:53.658482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1193/2372] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:14:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:14:53.702762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:53.704342 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:53.774590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8278f-478c-48da-a773-47f74bafbe08 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:53.780101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a085d-a349-40c7-b0de-41c0d2fd6b39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:53.780774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a085d-a349-40c7-b0de-41c0d2fd6b39 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:53.781052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a085d-a349-40c7-b0de-41c0d2fd6b39 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:53.781293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a085d-a349-40c7-b0de-41c0d2fd6b39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:53.789592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a085d-a349-40c7-b0de-41c0d2fd6b39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:53.791181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a085d-a349-40c7-b0de-41c0d2fd6b39 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:53.799150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1180/2373] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:14:54.323445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7616d-d1cb-49f6-8f72-32f2b89d4b6e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:54.323724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7616d-d1cb-49f6-8f72-32f2b89d4b6e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:54.324008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7616d-d1cb-49f6-8f72-32f2b89d4b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:54.342387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6da7616d-d1cb-49f6-8f72-32f2b89d4b6e None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:54.343592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6da7616d-d1cb-49f6-8f72-32f2b89d4b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:54.351751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1194/2374] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 23 17:14:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:14:54.366004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a085d-a349-40c7-b0de-41c0d2fd6b39 service swift] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:54.376831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a085d-a349-40c7-b0de-41c0d2fd6b39 service swift] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:54.383399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4766c-bbbe-4baa-b267-371d0a459546 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:54.384034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4766c-bbbe-4baa-b267-371d0a459546 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:54.384308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4766c-bbbe-4baa-b267-371d0a459546 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:54.384584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4766c-bbbe-4baa-b267-371d0a459546 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:54.392731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4766c-bbbe-4baa-b267-371d0a459546 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:54.394348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4766c-bbbe-4baa-b267-371d0a459546 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:54.402289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1181/2375] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:14:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:14:54.628786 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40275870-2e4a-4ea5-87da-ba284c2d7dc1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:54.629271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40275870-2e4a-4ea5-87da-ba284c2d7dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:54.629578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40275870-2e4a-4ea5-87da-ba284c2d7dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:54.648054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-40275870-2e4a-4ea5-87da-ba284c2d7dc1 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:54.649262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-40275870-2e4a-4ea5-87da-ba284c2d7dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:54.656547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1195/2376] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:14:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:54.670903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4766c-bbbe-4baa-b267-371d0a459546 service swift] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:54.681929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4766c-bbbe-4baa-b267-371d0a459546 service swift] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:54.687878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35718b8a-7165-4da5-bf7c-38658676fb7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:54.688511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35718b8a-7165-4da5-bf7c-38658676fb7b service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:54.689497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35718b8a-7165-4da5-bf7c-38658676fb7b service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:54.689820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35718b8a-7165-4da5-bf7c-38658676fb7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:54.699159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35718b8a-7165-4da5-bf7c-38658676fb7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:54.700766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35718b8a-7165-4da5-bf7c-38658676fb7b service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:54.709210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1182/2377] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:14:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:14:55.086117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25799-fe30-4cf4-b6bb-a0b452d3d899 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:55.086404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25799-fe30-4cf4-b6bb-a0b452d3d899 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:55.086675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25799-fe30-4cf4-b6bb-a0b452d3d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:55.104703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9cc25799-fe30-4cf4-b6bb-a0b452d3d899 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:55.105865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9cc25799-fe30-4cf4-b6bb-a0b452d3d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:55.113370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1196/2378] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 23 17:14:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:55.125382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35718b8a-7165-4da5-bf7c-38658676fb7b service swift] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:55.136896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35718b8a-7165-4da5-bf7c-38658676fb7b service swift] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:55.143137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec23fd5-2307-4929-ad12-8664dc3fa034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:55.143789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec23fd5-2307-4929-ad12-8664dc3fa034 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:55.144099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec23fd5-2307-4929-ad12-8664dc3fa034 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:55.144374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec23fd5-2307-4929-ad12-8664dc3fa034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:55.153171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec23fd5-2307-4929-ad12-8664dc3fa034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:55.154789 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec23fd5-2307-4929-ad12-8664dc3fa034 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:55.163049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1183/2379] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:14:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:14:59.369806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25799-fe30-4cf4-b6bb-a0b452d3d899 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:59.371240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9cc25799-fe30-4cf4-b6bb-a0b452d3d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:59.475211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25799-fe30-4cf4-b6bb-a0b452d3d899 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:59.481016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:59.482498 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:59.482880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:59.483277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] PATH_INFO: `/v3/users/4d5064e0f807490ab7f83657ff51a09f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:59.484761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5064e0f807490ab7f83657ff51a09f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:59.486858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:59.532667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:59.557440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5064e0f807490ab7f83657ff51a09f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.558113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5064e0f807490ab7f83657ff51a09f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.571763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5064e0f807490ab7f83657ff51a09f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.579159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5064e0f807490ab7f83657ff51a09f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.596083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5064e0f807490ab7f83657ff51a09f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.603875 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1197/2380] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:14:59 2022] DELETE /identity/v3/users/4d5064e0f807490ab7f83657ff51a09f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:59.609821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2cce-abb1-46f1-8f77-489f3d3ab88a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:59.610519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2cce-abb1-46f1-8f77-489f3d3ab88a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:59.610519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2cce-abb1-46f1-8f77-489f3d3ab88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:59.639891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-712d2cce-abb1-46f1-8f77-489f3d3ab88a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:59.641463 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-712d2cce-abb1-46f1-8f77-489f3d3ab88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:59.711732 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:14:59.724011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1184/2381] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:14:59.736125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:59.737621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:59.748996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2cce-abb1-46f1-8f77-489f3d3ab88a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:14:59.751136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-712d2cce-abb1-46f1-8f77-489f3d3ab88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:14:59.771803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2cce-abb1-46f1-8f77-489f3d3ab88a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:59.778289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:59.779408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:59.779710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:59.779977 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] PATH_INFO: `/v3/users/fdc4a8f96c3047bdaf94021e1baf1a1b` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:59.781434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc4a8f96c3047bdaf94021e1baf1a1b)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:59.783450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:59.841648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e11e9-6161-49c5-b359-39e954c0537e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:14:59.844430 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc4a8f96c3047bdaf94021e1baf1a1b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.846083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ffdbd-f9fa-4d64-b196-df606fd0c60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:14:59.847964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffdbd-f9fa-4d64-b196-df606fd0c60c service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:59.848252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffdbd-f9fa-4d64-b196-df606fd0c60c service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:59.848527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffdbd-f9fa-4d64-b196-df606fd0c60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:59.859522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc4a8f96c3047bdaf94021e1baf1a1b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.864102 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ffdbd-f9fa-4d64-b196-df606fd0c60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:14:59.868868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ffdbd-f9fa-4d64-b196-df606fd0c60c service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:14:59.878099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1198/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:14:59.894512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc4a8f96c3047bdaf94021e1baf1a1b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.902327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc4a8f96c3047bdaf94021e1baf1a1b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.903174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc4a8f96c3047bdaf94021e1baf1a1b'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:14:59.909766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1185/2383] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:14:59 2022] DELETE /identity/v3/users/fdc4a8f96c3047bdaf94021e1baf1a1b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:14:59.914396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c69b-a01a-4e1f-8b78-35df8562ceb1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:14:59.914689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c69b-a01a-4e1f-8b78-35df8562ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:14:59.914968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c69b-a01a-4e1f-8b78-35df8562ceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:14:59.932937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a6a9c69b-a01a-4e1f-8b78-35df8562ceb1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:14:59.934247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a6a9c69b-a01a-4e1f-8b78-35df8562ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:00.009252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1199/2384] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:00.022650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:00.024136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:00.125934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20717517-7500-4159-ac5d-50e2f9763b5a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:00.128714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c69b-a01a-4e1f-8b78-35df8562ceb1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:00.129982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353cce8-bb20-47e1-aba0-6a17391e757d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:00.130316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a6a9c69b-a01a-4e1f-8b78-35df8562ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:00.130971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cce8-bb20-47e1-aba0-6a17391e757d service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.130971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cce8-bb20-47e1-aba0-6a17391e757d service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.131216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cce8-bb20-47e1-aba0-6a17391e757d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.142524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353cce8-bb20-47e1-aba0-6a17391e757d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:00.144052 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353cce8-bb20-47e1-aba0-6a17391e757d service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:00.149880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c69b-a01a-4e1f-8b78-35df8562ceb1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:00.155809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1186/2385] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:00.157721 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:00.160043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.160392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.160703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] PATH_INFO: `/v3/projects/99c8d1e8f35e461dbdc25783106e4a44` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.169651 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c8d1e8f35e461dbdc25783106e4a44)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:00.171960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:00.217340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:00.250310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c8d1e8f35e461dbdc25783106e4a44', 'request_id': 'req-d5f6e178-d799-4c36-842e-45329c87fc0a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.276657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c8d1e8f35e461dbdc25783106e4a44', 'request_id': 'req-d5f6e178-d799-4c36-842e-45329c87fc0a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.289234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c8d1e8f35e461dbdc25783106e4a44', 'request_id': 'req-d5f6e178-d799-4c36-842e-45329c87fc0a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.322496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] The token cache is being invalidate because project 99c8d1e8f35e461dbdc25783106e4a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:00.323080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.325722 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5f6e178-d799-4c36-842e-45329c87fc0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.329830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1200/2386] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:00 2022] DELETE /identity/v3/projects/99c8d1e8f35e461dbdc25783106e4a44 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:15:00.332994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e350b-b31c-4b5f-8a6a-bf184d03a3ba None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.333358 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e350b-b31c-4b5f-8a6a-bf184d03a3ba None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.333710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e350b-b31c-4b5f-8a6a-bf184d03a3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.434620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-6e1e350b-b31c-4b5f-8a6a-bf184d03a3ba None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:00.436432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6e1e350b-b31c-4b5f-8a6a-bf184d03a3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:00.505538 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:00.530035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1187/2387] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:00.538879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3006-175c-41c6-bdcf-484aebe80c4b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.539569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3006-175c-41c6-bdcf-484aebe80c4b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.539569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df3006-175c-41c6-bdcf-484aebe80c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.565854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e350b-b31c-4b5f-8a6a-bf184d03a3ba None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:00.567512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6e1e350b-b31c-4b5f-8a6a-bf184d03a3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:00.568969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-38df3006-175c-41c6-bdcf-484aebe80c4b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:00.570637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-38df3006-175c-41c6-bdcf-484aebe80c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:00.594162 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1201/2388] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:00.598466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e350b-b31c-4b5f-8a6a-bf184d03a3ba None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:00.599465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df3006-175c-41c6-bdcf-484aebe80c4b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:00.604812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:00.605617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.605931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.606520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] PATH_INFO: `/v3/projects/9c8be53330104b5091ffefd2cf95ee81` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.607471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8be53330104b5091ffefd2cf95ee81)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:00.610123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:00.617555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df3006-175c-41c6-bdcf-484aebe80c4b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:00.628499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:00.629373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.629891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.630238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.631575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:15:00.632139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:00.636185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:00.664226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1202/2389] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:15:00.668413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:00.680545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f32b97-16de-4c9b-b4b2-1039f64fc1ea admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:00.700066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8be53330104b5091ffefd2cf95ee81', 'request_id': 'req-adbf1aca-c595-4132-a171-31f2ac811940'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.706015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8be53330104b5091ffefd2cf95ee81', 'request_id': 'req-adbf1aca-c595-4132-a171-31f2ac811940'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.712826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8be53330104b5091ffefd2cf95ee81', 'request_id': 'req-adbf1aca-c595-4132-a171-31f2ac811940'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.731970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] The token cache is being invalidate because project 9c8be53330104b5091ffefd2cf95ee81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:00.732313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.733118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:00.736473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1188/2390] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:00 2022] DELETE /identity/v3/projects/9c8be53330104b5091ffefd2cf95ee81 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:00.757117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:00.758984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.759092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.759478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.760333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:00.762518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:00.808369 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1203/2391] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:00 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:00.810050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:00.811901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:00.826010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf1aca-c595-4132-a171-31f2ac811940 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:00.924306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6325-a507-40a1-a052-88edc36e481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:00.925014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6325-a507-40a1-a052-88edc36e481d admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.925553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6325-a507-40a1-a052-88edc36e481d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.926180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6325-a507-40a1-a052-88edc36e481d admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.931004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6325-a507-40a1-a052-88edc36e481d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:00.932301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:00.934171 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:00.937376 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6325-a507-40a1-a052-88edc36e481d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:00.953305 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4fcb1-13da-4b95-81a6-52b9bc840c62 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:00.959262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:00.960871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:00.961157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:00.961500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] PATH_INFO: `/v3/users/5f734f2e317c4c99b2dc288e171add40` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:00.963170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f734f2e317c4c99b2dc288e171add40)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:00.965172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:00.979166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1189/2392] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:00 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:15:00.983143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6325-a507-40a1-a052-88edc36e481d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:00.993536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6325-a507-40a1-a052-88edc36e481d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:00.999468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24789f-1ee0-404c-bb66-32bed5905e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:01.000614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24789f-1ee0-404c-bb66-32bed5905e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.001185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24789f-1ee0-404c-bb66-32bed5905e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.001483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24789f-1ee0-404c-bb66-32bed5905e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.002729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24789f-1ee0-404c-bb66-32bed5905e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:01.004952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24789f-1ee0-404c-bb66-32bed5905e47 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:01.016964 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1190/2393] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:15:01.020936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24789f-1ee0-404c-bb66-32bed5905e47 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:01.024187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f734f2e317c4c99b2dc288e171add40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.024929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f734f2e317c4c99b2dc288e171add40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.031485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24789f-1ee0-404c-bb66-32bed5905e47 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:01.036700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f734f2e317c4c99b2dc288e171add40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.038213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9a2a-14e2-4f4c-8de5-aac70c6e817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:01.039137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9a2a-14e2-4f4c-8de5-aac70c6e817f admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.039425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9a2a-14e2-4f4c-8de5-aac70c6e817f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.039700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9a2a-14e2-4f4c-8de5-aac70c6e817f admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.040454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9a2a-14e2-4f4c-8de5-aac70c6e817f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:01.042064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9a2a-14e2-4f4c-8de5-aac70c6e817f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:01.045261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f734f2e317c4c99b2dc288e171add40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.065121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1191/2394] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:15:01.065121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9a2a-14e2-4f4c-8de5-aac70c6e817f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:01.065546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f4b4d3a9-5339-4f5e-9c19-84ce0a31e7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f734f2e317c4c99b2dc288e171add40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.070245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:01.072730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1204/2395] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:00 2022] DELETE /identity/v3/users/5f734f2e317c4c99b2dc288e171add40 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:01.073830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9a2a-14e2-4f4c-8de5-aac70c6e817f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:01.077519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc913c73-483b-459a-bb2d-c544a3915f38 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.079816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc913c73-483b-459a-bb2d-c544a3915f38 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.080349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc913c73-483b-459a-bb2d-c544a3915f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.106982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bc913c73-483b-459a-bb2d-c544a3915f38 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:01.108610 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bc913c73-483b-459a-bb2d-c544a3915f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:01.145683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:01.175485 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80e3b6-2b3b-4c87-b499-fa55a204fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:01.176709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80e3b6-2b3b-4c87-b499-fa55a204fa56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.176989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80e3b6-2b3b-4c87-b499-fa55a204fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.177265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80e3b6-2b3b-4c87-b499-fa55a204fa56 admin admin] PATH_INFO: `/v3/projects/e393091e3c2d42e79e9f2ec80d471faf/users/d21524f4232648ebaed76e1d7d5daf5f/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.197095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80e3b6-2b3b-4c87-b499-fa55a204fa56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e393091e3c2d42e79e9f2ec80d471faf, user_id=d21524f4232648ebaed76e1d7d5daf5f, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:01.198346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1205/2396] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:01.201451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80e3b6-2b3b-4c87-b499-fa55a204fa56 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:01.210737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc913c73-483b-459a-bb2d-c544a3915f38 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:01.213785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bc913c73-483b-459a-bb2d-c544a3915f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:01.218433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1192/2397] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:01 2022] PUT /identity/v3/projects/e393091e3c2d42e79e9f2ec80d471faf/users/d21524f4232648ebaed76e1d7d5daf5f/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:15:01.223798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60779-17bd-41f6-b5f4-911cfe156593 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.224173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60779-17bd-41f6-b5f4-911cfe156593 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.224521 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e60779-17bd-41f6-b5f4-911cfe156593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.248619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-f1e60779-17bd-41f6-b5f4-911cfe156593 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:01.249984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f1e60779-17bd-41f6-b5f4-911cfe156593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:01.295959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc913c73-483b-459a-bb2d-c544a3915f38 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:01.328938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1193/2398] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:15:01.338642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e60779-17bd-41f6-b5f4-911cfe156593 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:01.350758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:01.351635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.351920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.352194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.366692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:01.368192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:01.380332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1206/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:01.400473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e60779-17bd-41f6-b5f4-911cfe156593 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:01.404073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c2b0-d6f6-4ea5-b0b4-b1fc1e329228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:01.404729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c2b0-d6f6-4ea5-b0b4-b1fc1e329228 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.405012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c2b0-d6f6-4ea5-b0b4-b1fc1e329228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.405285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c2b0-d6f6-4ea5-b0b4-b1fc1e329228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.414801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93c2b0-d6f6-4ea5-b0b4-b1fc1e329228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:01.416246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93c2b0-d6f6-4ea5-b0b4-b1fc1e329228 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:01.426729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1194/2400] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:15:01.746933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:01.748390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:01.768247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a67b-4e7a-4367-bfad-8261b0af7cfc service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:01.782017 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:01.783067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.783383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.783663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] PATH_INFO: `/v3/projects/82dfe3ca0433478f817d062ec5557f75` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.785682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=82dfe3ca0433478f817d062ec5557f75)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:01.787701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:01.867510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:01.867510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82dfe3ca0433478f817d062ec5557f75', 'request_id': 'req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.874967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82dfe3ca0433478f817d062ec5557f75', 'request_id': 'req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.882130 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82dfe3ca0433478f817d062ec5557f75', 'request_id': 'req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.899346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] The token cache is being invalidate because project 82dfe3ca0433478f817d062ec5557f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:01.899905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.900725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:01.902520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1207/2401] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:01 2022] DELETE /identity/v3/projects/82dfe3ca0433478f817d062ec5557f75 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:01.906572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c2b0-d6f6-4ea5-b0b4-b1fc1e329228 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:01.918254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c2b0-d6f6-4ea5-b0b4-b1fc1e329228 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:01.982683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:01.983592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:01.984033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:01.984469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] PATH_INFO: `/v3/users/4191a25eba2747788632caf64246d024` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:01.985681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4191a25eba2747788632caf64246d024)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:01.987673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:02.001651 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:02.045824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4191a25eba2747788632caf64246d024'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.055036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4191a25eba2747788632caf64246d024'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.072384 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4191a25eba2747788632caf64246d024'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.081064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4191a25eba2747788632caf64246d024'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.081831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2c1e0d5e-f14b-4688-bd70-522f4b3539b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4191a25eba2747788632caf64246d024'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.089878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1195/2402] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:01 2022] DELETE /identity/v3/users/4191a25eba2747788632caf64246d024 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:15:02.444832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:02.447089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:02.469256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f942c-26b4-4dcd-b4f1-bdb403e370ab admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:02.532308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:02.533814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:02.534111 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:02.534708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] PATH_INFO: `/v3/projects/abbc1966d172468b9cdf3dbc6bebde75` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:02.535662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbc1966d172468b9cdf3dbc6bebde75)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:02.538599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:02.591604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbc1966d172468b9cdf3dbc6bebde75', 'request_id': 'req-a6b81955-6f43-47ef-a96a-1315e453e67c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.598453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbc1966d172468b9cdf3dbc6bebde75', 'request_id': 'req-a6b81955-6f43-47ef-a96a-1315e453e67c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.605169 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbc1966d172468b9cdf3dbc6bebde75', 'request_id': 'req-a6b81955-6f43-47ef-a96a-1315e453e67c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.621636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] The token cache is being invalidate because project abbc1966d172468b9cdf3dbc6bebde75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:02.622072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.622861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6b81955-6f43-47ef-a96a-1315e453e67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:02.626201 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1208/2403] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:02 2022] DELETE /identity/v3/projects/abbc1966d172468b9cdf3dbc6bebde75 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:02.643114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aeb17-df53-488f-bd74-1a60b6ea0aff None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:02.643525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aeb17-df53-488f-bd74-1a60b6ea0aff None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:02.643765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aeb17-df53-488f-bd74-1a60b6ea0aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:02.669737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a66aeb17-df53-488f-bd74-1a60b6ea0aff None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:02.671075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a66aeb17-df53-488f-bd74-1a60b6ea0aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:02.768419 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1196/2404] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:02.777713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15648e1-7519-4c3a-8927-d761fcea10cb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:02.778311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15648e1-7519-4c3a-8927-d761fcea10cb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:02.778311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15648e1-7519-4c3a-8927-d761fcea10cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:02.799283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c15648e1-7519-4c3a-8927-d761fcea10cb None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:02.800549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c15648e1-7519-4c3a-8927-d761fcea10cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:02.809677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1209/2405] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:02.814245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aeb17-df53-488f-bd74-1a60b6ea0aff None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:02.824937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aeb17-df53-488f-bd74-1a60b6ea0aff None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:02.830988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:02.831536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:02.831887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:02.832232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:02.833108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:15:02.833484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:02.835966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:02.851401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1197/2406] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:15:02.855739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15648e1-7519-4c3a-8927-d761fcea10cb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:02.866660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15648e1-7519-4c3a-8927-d761fcea10cb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:02.892430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360aeba4-8736-4810-83fb-1728d1766d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:02.893141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aeba4-8736-4810-83fb-1728d1766d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:02.893425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aeba4-8736-4810-83fb-1728d1766d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:02.893705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360aeba4-8736-4810-83fb-1728d1766d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:02.894461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360aeba4-8736-4810-83fb-1728d1766d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:02.896394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360aeba4-8736-4810-83fb-1728d1766d1b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:02.954182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1210/2407] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:02 2022] POST /identity/v3/projects => generated 397 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:02.958503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:02.971075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ce912-1d1f-4729-a7c9-ee8459167355 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:03.043935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de720d-4c54-4a26-9216-1e800202751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:03.045305 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de720d-4c54-4a26-9216-1e800202751e admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:03.045672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de720d-4c54-4a26-9216-1e800202751e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:03.047673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de720d-4c54-4a26-9216-1e800202751e admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:03.047673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de720d-4c54-4a26-9216-1e800202751e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:03.049830 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de720d-4c54-4a26-9216-1e800202751e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:03.078024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1198/2408] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:02 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:03.081738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360aeba4-8736-4810-83fb-1728d1766d1b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:03.097464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360aeba4-8736-4810-83fb-1728d1766d1b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:03.103882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7da2-3aeb-4736-8de4-b471d09fa231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:03.104753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7da2-3aeb-4736-8de4-b471d09fa231 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:03.105190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7da2-3aeb-4736-8de4-b471d09fa231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:03.105612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7da2-3aeb-4736-8de4-b471d09fa231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:03.113495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af7da2-3aeb-4736-8de4-b471d09fa231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:03.116775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af7da2-3aeb-4736-8de4-b471d09fa231 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:03.143231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1211/2409] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:15:03.147057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de720d-4c54-4a26-9216-1e800202751e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:03.159685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:03.171561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de720d-4c54-4a26-9216-1e800202751e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:03.177451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e15f8-f4df-45c4-b83b-df43519b7c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:03.178426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e15f8-f4df-45c4-b83b-df43519b7c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:03.178904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e15f8-f4df-45c4-b83b-df43519b7c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:03.179276 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e15f8-f4df-45c4-b83b-df43519b7c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:03.180163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e15f8-f4df-45c4-b83b-df43519b7c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:03.181987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e15f8-f4df-45c4-b83b-df43519b7c57 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:03.197164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1199/2410] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:03.199320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7da2-3aeb-4736-8de4-b471d09fa231 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:03.211716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7da2-3aeb-4736-8de4-b471d09fa231 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:03.220479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:03.221452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:03.221729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:03.222099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] PATH_INFO: `/v3/projects/4b0ade3474274120b965343249abcd50/users/6a71baf247e64e81b90cd303f1d546fd/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:03.241275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0ade3474274120b965343249abcd50, user_id=6a71baf247e64e81b90cd303f1d546fd, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:03.244115 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:03.267198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1212/2411] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:03 2022] PUT /identity/v3/projects/4b0ade3474274120b965343249abcd50/users/6a71baf247e64e81b90cd303f1d546fd/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:03.280291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ba34e-ea7e-43a3-be1a-e5c061f25d83 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:03.280587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ba34e-ea7e-43a3-be1a-e5c061f25d83 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:03.280856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ba34e-ea7e-43a3-be1a-e5c061f25d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:03.309941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-042ba34e-ea7e-43a3-be1a-e5c061f25d83 None None] MFA Rules not processed for user `6a71baf247e64e81b90cd303f1d546fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:03.311790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-042ba34e-ea7e-43a3-be1a-e5c061f25d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:03.388866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1200/2412] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:03.401026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:03.402929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:03.412907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:03.475624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257373ea-49a4-45f0-b186-6d395e37900e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:03.479450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:03.480107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:03.480386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:03.480661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:03.490859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:03.492194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:03.505320 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1213/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:05.826934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77484-ab7c-4ee1-875c-586a249efe3e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:05.827491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77484-ab7c-4ee1-875c-586a249efe3e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:05.827491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e77484-ab7c-4ee1-875c-586a249efe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:05.861627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-13e77484-ab7c-4ee1-875c-586a249efe3e None None] MFA Rules not processed for user `d21524f4232648ebaed76e1d7d5daf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:05.862803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-13e77484-ab7c-4ee1-875c-586a249efe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:05.930634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1201/2414] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:05.940357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:05.941908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:06.011235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb4d51-6b58-4655-93bb-e6153d7b22df service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:06.015714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c2ebd-b3c6-4212-8439-1453312ecf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:06.016377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c2ebd-b3c6-4212-8439-1453312ecf42 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:06.016667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c2ebd-b3c6-4212-8439-1453312ecf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:06.016943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c2ebd-b3c6-4212-8439-1453312ecf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:06.017641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c2ebd-b3c6-4212-8439-1453312ecf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:06.019574 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c2ebd-b3c6-4212-8439-1453312ecf42 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:06.047340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1214/2415] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:05 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:06.051397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e77484-ab7c-4ee1-875c-586a249efe3e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:06.063709 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e77484-ab7c-4ee1-875c-586a249efe3e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:06.168063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b21d2-6c31-4fcd-a621-00d4cbf64d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:06.168868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b21d2-6c31-4fcd-a621-00d4cbf64d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:06.169145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b21d2-6c31-4fcd-a621-00d4cbf64d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:06.169415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b21d2-6c31-4fcd-a621-00d4cbf64d76 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:06.170251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b21d2-6c31-4fcd-a621-00d4cbf64d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:06.172130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b21d2-6c31-4fcd-a621-00d4cbf64d76 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:06.208345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1202/2416] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:06 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:06.212773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c2ebd-b3c6-4212-8439-1453312ecf42 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:06.224156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c2ebd-b3c6-4212-8439-1453312ecf42 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:06.229665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b1c5-5f0a-4a8e-808a-3215f72b3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:06.230503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b1c5-5f0a-4a8e-808a-3215f72b3592 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:06.230860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b1c5-5f0a-4a8e-808a-3215f72b3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:06.231212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b1c5-5f0a-4a8e-808a-3215f72b3592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:06.232041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851b1c5-5f0a-4a8e-808a-3215f72b3592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:06.233829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851b1c5-5f0a-4a8e-808a-3215f72b3592 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:06.250367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1215/2417] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:06.251719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b21d2-6c31-4fcd-a621-00d4cbf64d76 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:06.257689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:06.265286 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b21d2-6c31-4fcd-a621-00d4cbf64d76 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:06.274308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81723f-8094-450a-9e51-dc8f0463a8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:06.275994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81723f-8094-450a-9e51-dc8f0463a8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:06.276355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81723f-8094-450a-9e51-dc8f0463a8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:06.276712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81723f-8094-450a-9e51-dc8f0463a8b6 admin admin] PATH_INFO: `/v3/projects/71ad97c2962e4f4291d1f5f31af2ede5/users/dddc0993c84f446f95d2371eab6c6dba/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:06.301189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81723f-8094-450a-9e51-dc8f0463a8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ad97c2962e4f4291d1f5f31af2ede5, user_id=dddc0993c84f446f95d2371eab6c6dba, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:06.304138 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81723f-8094-450a-9e51-dc8f0463a8b6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:06.322088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1203/2418] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:06 2022] PUT /identity/v3/projects/71ad97c2962e4f4291d1f5f31af2ede5/users/dddc0993c84f446f95d2371eab6c6dba/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:15:06.326854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b1c5-5f0a-4a8e-808a-3215f72b3592 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:06.340519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b1c5-5f0a-4a8e-808a-3215f72b3592 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:06.429312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fde79-7c4d-4930-91d3-58891b4367d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:06.430113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fde79-7c4d-4930-91d3-58891b4367d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:06.430461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fde79-7c4d-4930-91d3-58891b4367d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:06.430833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fde79-7c4d-4930-91d3-58891b4367d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:06.431672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fde79-7c4d-4930-91d3-58891b4367d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:06.433378 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fde79-7c4d-4930-91d3-58891b4367d8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:06.445141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1216/2419] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:15:06.450356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81723f-8094-450a-9e51-dc8f0463a8b6 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:06.463296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81723f-8094-450a-9e51-dc8f0463a8b6 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:06.470664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:06.471701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:06.471981 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:06.472254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] PATH_INFO: `/v3/projects/71ad97c2962e4f4291d1f5f31af2ede5/users/dddc0993c84f446f95d2371eab6c6dba/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:06.474575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ad97c2962e4f4291d1f5f31af2ede5, user_id=dddc0993c84f446f95d2371eab6c6dba, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:06.478063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:06.490634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1204/2420] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:06 2022] PUT /identity/v3/projects/71ad97c2962e4f4291d1f5f31af2ede5/users/dddc0993c84f446f95d2371eab6c6dba/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:15:07.563815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bccdf5-f83d-4479-8c28-7c761b2e5e63 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:07.564930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bccdf5-f83d-4479-8c28-7c761b2e5e63 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:07.565293 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bccdf5-f83d-4479-8c28-7c761b2e5e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:07.584496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c1bccdf5-f83d-4479-8c28-7c761b2e5e63 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:07.586097 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c1bccdf5-f83d-4479-8c28-7c761b2e5e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:07.601422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:07.704197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:07.705149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1217/2421] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:15:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:07.709935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:07.800724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ba89b-52ca-4c3f-89e2-9b07cf3f91f8 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:07.809280 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1f426-aad2-4cf2-bff0-02617b74165f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:07.810459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f426-aad2-4cf2-bff0-02617b74165f service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:07.811334 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f426-aad2-4cf2-bff0-02617b74165f service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:07.811817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f426-aad2-4cf2-bff0-02617b74165f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:07.825174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1f426-aad2-4cf2-bff0-02617b74165f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:07.826833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1f426-aad2-4cf2-bff0-02617b74165f service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:07.836531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1205/2422] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:15:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:15:08.289710 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bccdf5-f83d-4479-8c28-7c761b2e5e63 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:08.292722 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c1bccdf5-f83d-4479-8c28-7c761b2e5e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:08.467406 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bccdf5-f83d-4479-8c28-7c761b2e5e63 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:08.483332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:08.484269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:08.484682 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:08.485996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] PATH_INFO: `/v3/users/43f1105ad69e47f881b5e40638afc53b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:08.487108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f1105ad69e47f881b5e40638afc53b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:08.490931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:08.613761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f1105ad69e47f881b5e40638afc53b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:08.617624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f1105ad69e47f881b5e40638afc53b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:08.642165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f1105ad69e47f881b5e40638afc53b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:08.681828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f1105ad69e47f881b5e40638afc53b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:08.723823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f1105ad69e47f881b5e40638afc53b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:08.732455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1218/2423] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:08 2022] DELETE /identity/v3/users/43f1105ad69e47f881b5e40638afc53b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:08.737114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee300591-87d9-498a-9b97-69d1e27b058c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:08.737616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee300591-87d9-498a-9b97-69d1e27b058c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:08.737872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee300591-87d9-498a-9b97-69d1e27b058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:08.790506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-ee300591-87d9-498a-9b97-69d1e27b058c None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:08.793075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ee300591-87d9-498a-9b97-69d1e27b058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:08.921193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1206/2424] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:08.931847 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:08.933758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:09.027159 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:09.138170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb6fb3-0ec9-4c6f-acfb-2841dce1e7e3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:09.153854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956d7f7-5ef2-42c8-9bca-c6b399fefce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:09.153854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956d7f7-5ef2-42c8-9bca-c6b399fefce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:09.153854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956d7f7-5ef2-42c8-9bca-c6b399fefce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:09.153854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956d7f7-5ef2-42c8-9bca-c6b399fefce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:09.189966 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956d7f7-5ef2-42c8-9bca-c6b399fefce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:09.191862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956d7f7-5ef2-42c8-9bca-c6b399fefce2 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:09.226889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1219/2425] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:10.209920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee300591-87d9-498a-9b97-69d1e27b058c None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:10.211587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ee300591-87d9-498a-9b97-69d1e27b058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:10.236371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee300591-87d9-498a-9b97-69d1e27b058c None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:10.270128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:10.271043 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:10.271326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:10.271717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] PATH_INFO: `/v3/projects/af18d3afe2e24d249bd4656e0e29545c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:10.285962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af18d3afe2e24d249bd4656e0e29545c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:10.300212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:10.422993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af18d3afe2e24d249bd4656e0e29545c', 'request_id': 'req-e5317078-1d30-43ea-857d-5cb32c0ad25a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.426092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:10.447069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af18d3afe2e24d249bd4656e0e29545c', 'request_id': 'req-e5317078-1d30-43ea-857d-5cb32c0ad25a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.461875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af18d3afe2e24d249bd4656e0e29545c', 'request_id': 'req-e5317078-1d30-43ea-857d-5cb32c0ad25a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.501293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] The token cache is being invalidate because project af18d3afe2e24d249bd4656e0e29545c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:10.501855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.503470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.512475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1207/2426] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:10 2022] DELETE /identity/v3/projects/af18d3afe2e24d249bd4656e0e29545c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:10.516202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956d7f7-5ef2-42c8-9bca-c6b399fefce2 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:10.534883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956d7f7-5ef2-42c8-9bca-c6b399fefce2 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:10.733436 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:10.735387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:10.735908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:10.736391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] PATH_INFO: `/v3/users/81cd9858365442afa5728d10b3938a3c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:10.738043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cd9858365442afa5728d10b3938a3c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:10.740513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:10.858696 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cd9858365442afa5728d10b3938a3c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.859407 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cd9858365442afa5728d10b3938a3c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.892617 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cd9858365442afa5728d10b3938a3c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.925329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cd9858365442afa5728d10b3938a3c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:10.989895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2f850e82-49be-4ccf-9ef9-acb6146df07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cd9858365442afa5728d10b3938a3c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:11.030234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1220/2427] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:10 2022] DELETE /identity/v3/users/81cd9858365442afa5728d10b3938a3c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:11.642764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:11.644787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:11.670711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317078-1d30-43ea-857d-5cb32c0ad25a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:11.808022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:11.809241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:11.809676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:11.810122 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] PATH_INFO: `/v3/projects/2688e76f2bfe449fb60066a5aacf1052` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:11.811983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2688e76f2bfe449fb60066a5aacf1052)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:11.814145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:11.898924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2688e76f2bfe449fb60066a5aacf1052', 'request_id': 'req-4c6ea76c-de66-4d7b-b043-09070c5016eb'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:11.905742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2688e76f2bfe449fb60066a5aacf1052', 'request_id': 'req-4c6ea76c-de66-4d7b-b043-09070c5016eb'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:11.913399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2688e76f2bfe449fb60066a5aacf1052', 'request_id': 'req-4c6ea76c-de66-4d7b-b043-09070c5016eb'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:11.936818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] The token cache is being invalidate because project 2688e76f2bfe449fb60066a5aacf1052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:11.939346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:11.942161 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4c6ea76c-de66-4d7b-b043-09070c5016eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:11.944718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1208/2428] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:11 2022] DELETE /identity/v3/projects/2688e76f2bfe449fb60066a5aacf1052 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:11.949889 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dc790-9dbf-4059-8b2f-322f8b3e7d93 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:11.950468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dc790-9dbf-4059-8b2f-322f8b3e7d93 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:11.950551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dc790-9dbf-4059-8b2f-322f8b3e7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:11.989006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4b8dc790-9dbf-4059-8b2f-322f8b3e7d93 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:11.990321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4b8dc790-9dbf-4059-8b2f-322f8b3e7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:12.107859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:12.136969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1221/2429] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:12.144586 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5145b99-7274-4314-aa17-948296e569ef None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:12.144873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5145b99-7274-4314-aa17-948296e569ef None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:12.145149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5145b99-7274-4314-aa17-948296e569ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:12.179070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c5145b99-7274-4314-aa17-948296e569ef None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:12.180383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c5145b99-7274-4314-aa17-948296e569ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:12.201119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1209/2430] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:12.206063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dc790-9dbf-4059-8b2f-322f8b3e7d93 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:12.216708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dc790-9dbf-4059-8b2f-322f8b3e7d93 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:12.234552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:12.235256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:12.235536 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:12.235813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:12.236572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:15:12.236877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:12.238588 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:12.256261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1222/2431] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:15:12.257500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5145b99-7274-4314-aa17-948296e569ef None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:12.268588 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5145b99-7274-4314-aa17-948296e569ef None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:12.288495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5e24b-f61a-412f-b05d-4a4b4b8e3a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:12.289201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e24b-f61a-412f-b05d-4a4b4b8e3a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:12.289480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e24b-f61a-412f-b05d-4a4b4b8e3a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:12.289750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e24b-f61a-412f-b05d-4a4b4b8e3a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:12.290693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5e24b-f61a-412f-b05d-4a4b4b8e3a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:12.292472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5e24b-f61a-412f-b05d-4a4b4b8e3a4f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:12.350370 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1210/2432] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:12 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:12.354687 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:12.378317 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f74ff-a238-4dd1-97b0-0a2735375d5e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:12.492885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7d0ba-5d06-444a-a467-c622b10faad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:12.493592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7d0ba-5d06-444a-a467-c622b10faad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:12.493917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7d0ba-5d06-444a-a467-c622b10faad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:12.494256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7d0ba-5d06-444a-a467-c622b10faad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:12.494944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7d0ba-5d06-444a-a467-c622b10faad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:12.496895 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7d0ba-5d06-444a-a467-c622b10faad6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:12.554160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1223/2433] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:12 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:12.558221 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5e24b-f61a-412f-b05d-4a4b4b8e3a4f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:12.578018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5e24b-f61a-412f-b05d-4a4b4b8e3a4f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:12.596610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361a0c-b25e-4f4c-9fde-e16b80c4f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:12.598343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361a0c-b25e-4f4c-9fde-e16b80c4f26a admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:12.601735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361a0c-b25e-4f4c-9fde-e16b80c4f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:12.601999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361a0c-b25e-4f4c-9fde-e16b80c4f26a admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:12.602777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0361a0c-b25e-4f4c-9fde-e16b80c4f26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:12.604602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0361a0c-b25e-4f4c-9fde-e16b80c4f26a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:12.632885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7d0ba-5d06-444a-a467-c622b10faad6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:12.633113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1211/2434] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:12.653264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7d0ba-5d06-444a-a467-c622b10faad6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:12.670391 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819afd6d-7a34-4144-a896-cf0b302d0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:12.671475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819afd6d-7a34-4144-a896-cf0b302d0951 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:12.671942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819afd6d-7a34-4144-a896-cf0b302d0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:12.672492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819afd6d-7a34-4144-a896-cf0b302d0951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:12.673818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819afd6d-7a34-4144-a896-cf0b302d0951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:12.696648 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819afd6d-7a34-4144-a896-cf0b302d0951 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:12.735952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1224/2435] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:12.738780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361a0c-b25e-4f4c-9fde-e16b80c4f26a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:12.751791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361a0c-b25e-4f4c-9fde-e16b80c4f26a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:12.778179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1751ce-69c3-417a-9e48-e5ff79a3843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:12.779436 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1751ce-69c3-417a-9e48-e5ff79a3843d admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:12.779868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1751ce-69c3-417a-9e48-e5ff79a3843d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:12.780289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1751ce-69c3-417a-9e48-e5ff79a3843d admin admin] PATH_INFO: `/v3/projects/e48477b4ac59421e809d172cc0bc5ed5/users/3e6f35a21e624f39a059f73bec4c046a/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:12.808899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1751ce-69c3-417a-9e48-e5ff79a3843d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48477b4ac59421e809d172cc0bc5ed5, user_id=3e6f35a21e624f39a059f73bec4c046a, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:12.812262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1751ce-69c3-417a-9e48-e5ff79a3843d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:12.856293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1212/2436] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:12 2022] PUT /identity/v3/projects/e48477b4ac59421e809d172cc0bc5ed5/users/3e6f35a21e624f39a059f73bec4c046a/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:12.867374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7ec20-e9c9-4d83-8776-7972e9f2c3b3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:12.868360 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7ec20-e9c9-4d83-8776-7972e9f2c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:12.869005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7ec20-e9c9-4d83-8776-7972e9f2c3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:12.917073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-afa7ec20-e9c9-4d83-8776-7972e9f2c3b3 None None] MFA Rules not processed for user `3e6f35a21e624f39a059f73bec4c046a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:12.919667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-afa7ec20-e9c9-4d83-8776-7972e9f2c3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:13.015871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1225/2437] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:13.016598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1751ce-69c3-417a-9e48-e5ff79a3843d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:13.023325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:13.148887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1751ce-69c3-417a-9e48-e5ff79a3843d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:13.155271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c885a9b-bf9c-4536-8d2c-4bf8906e4efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:13.156084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885a9b-bf9c-4536-8d2c-4bf8906e4efb admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:13.156467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885a9b-bf9c-4536-8d2c-4bf8906e4efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:13.163947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885a9b-bf9c-4536-8d2c-4bf8906e4efb admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:13.164948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c885a9b-bf9c-4536-8d2c-4bf8906e4efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:13.172306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c885a9b-bf9c-4536-8d2c-4bf8906e4efb admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:13.234249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7ec20-e9c9-4d83-8776-7972e9f2c3b3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:13.246561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1213/2438] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:13 2022] POST /identity/v3/projects => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:13.249145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7ec20-e9c9-4d83-8776-7972e9f2c3b3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:13.345649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:13.379058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717895e-c5bd-4508-ae0e-46f29c125fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:13.379922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717895e-c5bd-4508-ae0e-46f29c125fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:13.380339 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717895e-c5bd-4508-ae0e-46f29c125fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:13.381238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717895e-c5bd-4508-ae0e-46f29c125fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:13.382362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717895e-c5bd-4508-ae0e-46f29c125fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:13.384548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717895e-c5bd-4508-ae0e-46f29c125fe0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:13.430453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1226/2439] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:13 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:13.433090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c885a9b-bf9c-4536-8d2c-4bf8906e4efb admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:13.468107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c885a9b-bf9c-4536-8d2c-4bf8906e4efb admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:13.491947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca142d-f59f-4d88-a173-5b012f6c78c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:13.492663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca142d-f59f-4d88-a173-5b012f6c78c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:13.492943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca142d-f59f-4d88-a173-5b012f6c78c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:13.493218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca142d-f59f-4d88-a173-5b012f6c78c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:13.497316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca142d-f59f-4d88-a173-5b012f6c78c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:13.498999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca142d-f59f-4d88-a173-5b012f6c78c1 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:13.531411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717895e-c5bd-4508-ae0e-46f29c125fe0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:13.542995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1214/2440] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:13.544085 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717895e-c5bd-4508-ae0e-46f29c125fe0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:13.573338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8ad9f-3dd6-4fa1-8781-838e9a37a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:13.574388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ad9f-3dd6-4fa1-8781-838e9a37a79d admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:13.574777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ad9f-3dd6-4fa1-8781-838e9a37a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:13.575073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ad9f-3dd6-4fa1-8781-838e9a37a79d admin admin] PATH_INFO: `/v3/projects/a173605b259e49d1991b1bb1b499f718/users/6eb5d4e6ddbe49628fe71ef73f4826ae/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:13.597476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8ad9f-3dd6-4fa1-8781-838e9a37a79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a173605b259e49d1991b1bb1b499f718, user_id=6eb5d4e6ddbe49628fe71ef73f4826ae, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:13.605641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8ad9f-3dd6-4fa1-8781-838e9a37a79d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:13.645433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca142d-f59f-4d88-a173-5b012f6c78c1 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:13.654857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1227/2441] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:13 2022] PUT /identity/v3/projects/a173605b259e49d1991b1bb1b499f718/users/6eb5d4e6ddbe49628fe71ef73f4826ae/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:13.661938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca142d-f59f-4d88-a173-5b012f6c78c1 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:13.893376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428ac0-6c0f-49dd-bef2-8e2b7d8cf0dd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:13.893707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428ac0-6c0f-49dd-bef2-8e2b7d8cf0dd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:13.893979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428ac0-6c0f-49dd-bef2-8e2b7d8cf0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:13.928188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cfd89-b196-4c2d-bb7f-e2915533832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:13.932728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cfd89-b196-4c2d-bb7f-e2915533832e admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:13.933136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cfd89-b196-4c2d-bb7f-e2915533832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:13.933484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cfd89-b196-4c2d-bb7f-e2915533832e admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:13.935011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cfd89-b196-4c2d-bb7f-e2915533832e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:13.937133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cfd89-b196-4c2d-bb7f-e2915533832e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:13.939297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2c428ac0-6c0f-49dd-bef2-8e2b7d8cf0dd None None] MFA Rules not processed for user `dddc0993c84f446f95d2371eab6c6dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:13.940751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2c428ac0-6c0f-49dd-bef2-8e2b7d8cf0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:13.954516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1215/2442] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:13.955734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cfd89-b196-4c2d-bb7f-e2915533832e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:13.971531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cfd89-b196-4c2d-bb7f-e2915533832e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:13.981186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691c21e-5ff8-4ed1-998e-8dea08ebdccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:13.982143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c21e-5ff8-4ed1-998e-8dea08ebdccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:13.982526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c21e-5ff8-4ed1-998e-8dea08ebdccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:13.982683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691c21e-5ff8-4ed1-998e-8dea08ebdccf admin admin] PATH_INFO: `/v3/projects/a173605b259e49d1991b1bb1b499f718/users/6eb5d4e6ddbe49628fe71ef73f4826ae/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:13.984705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691c21e-5ff8-4ed1-998e-8dea08ebdccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a173605b259e49d1991b1bb1b499f718, user_id=6eb5d4e6ddbe49628fe71ef73f4826ae, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:13.988645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691c21e-5ff8-4ed1-998e-8dea08ebdccf admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:14.003624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1216/2443] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:13 2022] PUT /identity/v3/projects/a173605b259e49d1991b1bb1b499f718/users/6eb5d4e6ddbe49628fe71ef73f4826ae/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:14.017664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3360625-c2d2-492a-92cd-7c7339e344ec None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:14.018045 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3360625-c2d2-492a-92cd-7c7339e344ec None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:14.018248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3360625-c2d2-492a-92cd-7c7339e344ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:14.066300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d3360625-c2d2-492a-92cd-7c7339e344ec None None] MFA Rules not processed for user `6eb5d4e6ddbe49628fe71ef73f4826ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:14.068261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d3360625-c2d2-492a-92cd-7c7339e344ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:14.104628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1228/2444] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:15:14.112512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428ac0-6c0f-49dd-bef2-8e2b7d8cf0dd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:14.129343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2c428ac0-6c0f-49dd-bef2-8e2b7d8cf0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:14.193765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:14.234106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1217/2445] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:14.246226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3360625-c2d2-492a-92cd-7c7339e344ec None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:14.247802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d3360625-c2d2-492a-92cd-7c7339e344ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:14.300663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428ac0-6c0f-49dd-bef2-8e2b7d8cf0dd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:14.323709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:14.347580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3360625-c2d2-492a-92cd-7c7339e344ec None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:14.351888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:14.352540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:14.352874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:14.353161 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:14.363055 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:14.364527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:14.375192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1218/2446] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:14.375358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:14.375929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:14.376250 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:14.376527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:14.378367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:14.436707 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:14.438194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:14.449834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3422a-f7cd-48da-985f-65ee687f755b service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:14.450294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:14.452030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:14.454222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a08895-d46c-424d-a423-e49fdada4b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:14.454390 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a08895-d46c-424d-a423-e49fdada4b8d service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:14.454672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a08895-d46c-424d-a423-e49fdada4b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:14.454944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a08895-d46c-424d-a423-e49fdada4b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:14.470184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1229/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:14.520443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a08895-d46c-424d-a423-e49fdada4b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:14.522253 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a08895-d46c-424d-a423-e49fdada4b8d service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:14.532941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1219/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:15:18.738204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:18.917041 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13590-488b-4ce4-b70d-c4dfbb5f43d3 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:18.929319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:18.930271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:18.930546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:18.930820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] PATH_INFO: `/v3/users/3e6f35a21e624f39a059f73bec4c046a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:18.934114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6f35a21e624f39a059f73bec4c046a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:18.937579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:19.053282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6f35a21e624f39a059f73bec4c046a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.054307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6f35a21e624f39a059f73bec4c046a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.071837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6f35a21e624f39a059f73bec4c046a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.086736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:19.093001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6f35a21e624f39a059f73bec4c046a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.107688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6f35a21e624f39a059f73bec4c046a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.118052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1230/2449] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:18 2022] DELETE /identity/v3/users/3e6f35a21e624f39a059f73bec4c046a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:19.119974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475ec9-e31c-49f8-8d6b-852549915855 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:19.120477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475ec9-e31c-49f8-8d6b-852549915855 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:19.120737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475ec9-e31c-49f8-8d6b-852549915855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:19.140705 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9f475ec9-e31c-49f8-8d6b-852549915855 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:19.141973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9f475ec9-e31c-49f8-8d6b-852549915855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:19.254860 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1220/2450] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:19.262072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:19.263204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:19.333981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb513-a23c-4aaf-9e27-7feb595683aa admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:19.338832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50dc8-1b6f-476a-934e-37116af2588d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:19.339715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dc8-1b6f-476a-934e-37116af2588d service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:19.340302 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dc8-1b6f-476a-934e-37116af2588d service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:19.340732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dc8-1b6f-476a-934e-37116af2588d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:19.352177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50dc8-1b6f-476a-934e-37116af2588d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:19.353995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50dc8-1b6f-476a-934e-37116af2588d service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:19.364698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1231/2451] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:19.690031 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f475ec9-e31c-49f8-8d6b-852549915855 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:19.691933 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9f475ec9-e31c-49f8-8d6b-852549915855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:19.722064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f475ec9-e31c-49f8-8d6b-852549915855 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:19.728819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:19.729714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:19.730028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:19.730408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] PATH_INFO: `/v3/projects/e48477b4ac59421e809d172cc0bc5ed5` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:19.732403 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48477b4ac59421e809d172cc0bc5ed5)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:19.734643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:19.738023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:19.797109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48477b4ac59421e809d172cc0bc5ed5', 'request_id': 'req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.804622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48477b4ac59421e809d172cc0bc5ed5', 'request_id': 'req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.813083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48477b4ac59421e809d172cc0bc5ed5', 'request_id': 'req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.829003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] The token cache is being invalidate because project e48477b4ac59421e809d172cc0bc5ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:19.829313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.829997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.831878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1221/2452] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:19 2022] DELETE /identity/v3/projects/e48477b4ac59421e809d172cc0bc5ed5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:19.836322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50dc8-1b6f-476a-934e-37116af2588d service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:19.846583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50dc8-1b6f-476a-934e-37116af2588d service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:19.922223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:19.923401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:19.923836 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:19.924450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] PATH_INFO: `/v3/users/6eb5d4e6ddbe49628fe71ef73f4826ae` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:19.925902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb5d4e6ddbe49628fe71ef73f4826ae)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:19.928128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:19.992185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb5d4e6ddbe49628fe71ef73f4826ae'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:19.993461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb5d4e6ddbe49628fe71ef73f4826ae'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.011301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb5d4e6ddbe49628fe71ef73f4826ae'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.020578 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb5d4e6ddbe49628fe71ef73f4826ae'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.047951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a46bc2f0-6b8c-4f8a-a6f1-39e911017bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb5d4e6ddbe49628fe71ef73f4826ae'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.050505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:20.058841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1232/2453] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:19 2022] DELETE /identity/v3/users/6eb5d4e6ddbe49628fe71ef73f4826ae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:20.105212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:20.106995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:20.122034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5d5e-8a6c-41a1-a3dc-b5f7f48565fe admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:20.195180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:20.195180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:20.195180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:20.195180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] PATH_INFO: `/v3/users/6a71baf247e64e81b90cd303f1d546fd` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:20.195656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a71baf247e64e81b90cd303f1d546fd)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:20.195656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:20.261631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a71baf247e64e81b90cd303f1d546fd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.274136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a71baf247e64e81b90cd303f1d546fd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.292632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a71baf247e64e81b90cd303f1d546fd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.321845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a71baf247e64e81b90cd303f1d546fd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.322893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a71baf247e64e81b90cd303f1d546fd'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.332456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1222/2454] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:20 2022] DELETE /identity/v3/users/6a71baf247e64e81b90cd303f1d546fd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:20.337013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6ef2b-df28-4d9d-9a8f-46beec866a10 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:20.337455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6ef2b-df28-4d9d-9a8f-46beec866a10 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:20.337856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6ef2b-df28-4d9d-9a8f-46beec866a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:20.361652 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-62e6ef2b-df28-4d9d-9a8f-46beec866a10 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:20.363346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-62e6ef2b-df28-4d9d-9a8f-46beec866a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:20.443987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:20.447541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1233/2455] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:20.448414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:20.473940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6ef2b-df28-4d9d-9a8f-46beec866a10 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:20.475614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-62e6ef2b-df28-4d9d-9a8f-46beec866a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:20.479431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf50186-1977-48ab-8a3d-862e34390284 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:20.491744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:20.492692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:20.493437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:20.493731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] PATH_INFO: `/v3/projects/a173605b259e49d1991b1bb1b499f718` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:20.495379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a173605b259e49d1991b1bb1b499f718)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:20.497939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:20.506846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:20.551032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6ef2b-df28-4d9d-9a8f-46beec866a10 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:20.556121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61790c16-8fc5-4368-8838-2f4bf2c2596d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:20.556980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61790c16-8fc5-4368-8838-2f4bf2c2596d service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:20.557246 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61790c16-8fc5-4368-8838-2f4bf2c2596d service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:20.558004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61790c16-8fc5-4368-8838-2f4bf2c2596d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:20.571522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61790c16-8fc5-4368-8838-2f4bf2c2596d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:20.573105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61790c16-8fc5-4368-8838-2f4bf2c2596d service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:20.585520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1234/2456] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:20.590524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a173605b259e49d1991b1bb1b499f718', 'request_id': 'req-251920a6-3d7d-46d9-a1c3-eb69504c4663'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.600633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a173605b259e49d1991b1bb1b499f718', 'request_id': 'req-251920a6-3d7d-46d9-a1c3-eb69504c4663'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.621194 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a173605b259e49d1991b1bb1b499f718', 'request_id': 'req-251920a6-3d7d-46d9-a1c3-eb69504c4663'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.647155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] The token cache is being invalidate because project a173605b259e49d1991b1bb1b499f718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:20.647450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.648196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-251920a6-3d7d-46d9-a1c3-eb69504c4663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:20.649829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1223/2457] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:20 2022] DELETE /identity/v3/projects/a173605b259e49d1991b1bb1b499f718 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:20.655154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8fc28-38de-4383-b0f3-3d2b2c31cbe4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:20.655447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8fc28-38de-4383-b0f3-3d2b2c31cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:20.655758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8fc28-38de-4383-b0f3-3d2b2c31cbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:20.691567 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-deb8fc28-38de-4383-b0f3-3d2b2c31cbe4 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:20.692913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-deb8fc28-38de-4383-b0f3-3d2b2c31cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:20.787379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1235/2458] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:20.789279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1c2c-982c-4c76-82a6-46429460518a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:20.789592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1c2c-982c-4c76-82a6-46429460518a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:20.789899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1c2c-982c-4c76-82a6-46429460518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:20.817460 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-01dc1c2c-982c-4c76-82a6-46429460518a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:20.819008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-01dc1c2c-982c-4c76-82a6-46429460518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:20.829509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1224/2459] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:20.833621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8fc28-38de-4383-b0f3-3d2b2c31cbe4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:20.845770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8fc28-38de-4383-b0f3-3d2b2c31cbe4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:20.863184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:20.864035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:20.864170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:20.864421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:20.865287 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:15:20.865631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:20.867856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:20.896590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1236/2460] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:15:20.900994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1c2c-982c-4c76-82a6-46429460518a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:20.918090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1c2c-982c-4c76-82a6-46429460518a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:20.923646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406c936-5660-45e9-8957-312bd96c67a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:20.924328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c936-5660-45e9-8957-312bd96c67a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:20.924608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c936-5660-45e9-8957-312bd96c67a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:20.924880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c936-5660-45e9-8957-312bd96c67a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:20.925596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c936-5660-45e9-8957-312bd96c67a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:20.927645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c936-5660-45e9-8957-312bd96c67a3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:20.961767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:20.963784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:20.964879 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1225/2461] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:20 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:15:20.968797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406c936-5660-45e9-8957-312bd96c67a3 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:20.988762 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa43c7-47f4-47b8-aaf8-76d5f08cc600 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.031015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:21.055734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406c936-5660-45e9-8957-312bd96c67a3 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.063542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442d036-461a-46b2-aa02-1a83763a865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.064962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d036-461a-46b2-aa02-1a83763a865f admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.065648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d036-461a-46b2-aa02-1a83763a865f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.066300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d036-461a-46b2-aa02-1a83763a865f admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.067583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442d036-461a-46b2-aa02-1a83763a865f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.070975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442d036-461a-46b2-aa02-1a83763a865f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.075831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.076698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.077031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.077318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] PATH_INFO: `/v3/projects/4b0ade3474274120b965343249abcd50` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.078593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0ade3474274120b965343249abcd50)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.080537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.120190 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1226/2462] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:20 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:15:21.125030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442d036-461a-46b2-aa02-1a83763a865f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.140604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442d036-461a-46b2-aa02-1a83763a865f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.151021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b97296-3627-4d65-ad5b-b5ca9d50dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.152048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97296-3627-4d65-ad5b-b5ca9d50dee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.153022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97296-3627-4d65-ad5b-b5ca9d50dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.153564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97296-3627-4d65-ad5b-b5ca9d50dee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.155233 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b97296-3627-4d65-ad5b-b5ca9d50dee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.157777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b97296-3627-4d65-ad5b-b5ca9d50dee2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.169509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0ade3474274120b965343249abcd50', 'request_id': 'req-c4ebcd47-b137-448b-81ac-8a036725ddee'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:21.175349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1227/2463] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:21.177209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b97296-3627-4d65-ad5b-b5ca9d50dee2 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.181512 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0ade3474274120b965343249abcd50', 'request_id': 'req-c4ebcd47-b137-448b-81ac-8a036725ddee'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:21.191693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0ade3474274120b965343249abcd50', 'request_id': 'req-c4ebcd47-b137-448b-81ac-8a036725ddee'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:21.191918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b97296-3627-4d65-ad5b-b5ca9d50dee2 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.275140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] The token cache is being invalidate because project 4b0ade3474274120b965343249abcd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:21.275140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:21.275140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c4ebcd47-b137-448b-81ac-8a036725ddee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:21.281147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1237/2464] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:20 2022] DELETE /identity/v3/projects/4b0ade3474274120b965343249abcd50 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:21.282508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920ab52-0ad5-47cc-a587-7783df4c47d9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.282797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920ab52-0ad5-47cc-a587-7783df4c47d9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.283197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920ab52-0ad5-47cc-a587-7783df4c47d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.308209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:21.331388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.334152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.334714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.335088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.336283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.339668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.358949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1228/2465] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:21.363160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.365828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:21.375590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e920ab52-0ad5-47cc-a587-7783df4c47d9 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:21.377991 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e920ab52-0ad5-47cc-a587-7783df4c47d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:21.382181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56ec9e-575a-45fe-b0e3-f038e6c00461 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.399603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1238/2466] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:21.407570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571d59-2995-4ee5-b874-59d69943b5af None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.408043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571d59-2995-4ee5-b874-59d69943b5af None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.408343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571d59-2995-4ee5-b874-59d69943b5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.421736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cad5a6-fbfe-401b-a634-80ea26cfcf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.423101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad5a6-fbfe-401b-a634-80ea26cfcf9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.423519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad5a6-fbfe-401b-a634-80ea26cfcf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.423935 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cad5a6-fbfe-401b-a634-80ea26cfcf9b admin admin] PATH_INFO: `/v3/projects/fb865ff0b41a41c58ba76baefaef8bcc/users/f5627e1d80cb48c6941032832412ef7d/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.440827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c6571d59-2995-4ee5-b874-59d69943b5af None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:21.442306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c6571d59-2995-4ee5-b874-59d69943b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:21.456231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cad5a6-fbfe-401b-a634-80ea26cfcf9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb865ff0b41a41c58ba76baefaef8bcc, user_id=f5627e1d80cb48c6941032832412ef7d, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.459429 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cad5a6-fbfe-401b-a634-80ea26cfcf9b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.476208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1239/2467] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:15:21.476208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571d59-2995-4ee5-b874-59d69943b5af None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.485380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1229/2468] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:21 2022] PUT /identity/v3/projects/fb865ff0b41a41c58ba76baefaef8bcc/users/f5627e1d80cb48c6941032832412ef7d/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:15:21.495958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571d59-2995-4ee5-b874-59d69943b5af None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.497289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3ac11-4e2f-4e15-a3b5-df20360ffef2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.498568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3ac11-4e2f-4e15-a3b5-df20360ffef2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.499782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3ac11-4e2f-4e15-a3b5-df20360ffef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.541084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-92f3ac11-4e2f-4e15-a3b5-df20360ffef2 None None] MFA Rules not processed for user `f5627e1d80cb48c6941032832412ef7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:21.543118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-92f3ac11-4e2f-4e15-a3b5-df20360ffef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:21.575778 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.576490 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.576673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.576983 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.577727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:15:21.578565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.580337 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.596706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1240/2469] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:15:21.602870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.614298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dbba8-9df2-4cd3-bda7-5af95fa09a83 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.620628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c90ec-19bd-4477-8f41-88dd33e5cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.621303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c90ec-19bd-4477-8f41-88dd33e5cdbf admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.621585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c90ec-19bd-4477-8f41-88dd33e5cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.621892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c90ec-19bd-4477-8f41-88dd33e5cdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.622597 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c90ec-19bd-4477-8f41-88dd33e5cdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.624964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c90ec-19bd-4477-8f41-88dd33e5cdbf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.633307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1230/2470] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:21.634910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3ac11-4e2f-4e15-a3b5-df20360ffef2 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.649649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3ac11-4e2f-4e15-a3b5-df20360ffef2 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.655081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b2f8b-92b8-4786-a4f6-05cd27d07426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.655760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b2f8b-92b8-4786-a4f6-05cd27d07426 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.656044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b2f8b-92b8-4786-a4f6-05cd27d07426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.656317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b2f8b-92b8-4786-a4f6-05cd27d07426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.657078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b2f8b-92b8-4786-a4f6-05cd27d07426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.659143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b2f8b-92b8-4786-a4f6-05cd27d07426 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.666616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1241/2471] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:21 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:21.668210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c90ec-19bd-4477-8f41-88dd33e5cdbf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.703934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1231/2472] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:21 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:15:21.704117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:21.710386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b2f8b-92b8-4786-a4f6-05cd27d07426 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.786917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c90ec-19bd-4477-8f41-88dd33e5cdbf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.811934 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b2f8b-92b8-4786-a4f6-05cd27d07426 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.817322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639c6cd-ebae-46ba-9b56-58583131228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.818410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639c6cd-ebae-46ba-9b56-58583131228c admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.819084 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639c6cd-ebae-46ba-9b56-58583131228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.820013 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639c6cd-ebae-46ba-9b56-58583131228c admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.821047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639c6cd-ebae-46ba-9b56-58583131228c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.823502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639c6cd-ebae-46ba-9b56-58583131228c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.853929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1232/2473] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:21 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:21.854390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123b398-4025-4582-8f9d-184c295c462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.855081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b398-4025-4582-8f9d-184c295c462f admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.855364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b398-4025-4582-8f9d-184c295c462f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.855638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b398-4025-4582-8f9d-184c295c462f admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.856368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123b398-4025-4582-8f9d-184c295c462f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.857578 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639c6cd-ebae-46ba-9b56-58583131228c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.858364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123b398-4025-4582-8f9d-184c295c462f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.868777 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639c6cd-ebae-46ba-9b56-58583131228c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.873843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5c50d-15bb-4bba-ab51-6a1255628be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.874519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5c50d-15bb-4bba-ab51-6a1255628be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.874843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5c50d-15bb-4bba-ab51-6a1255628be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.875162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5c50d-15bb-4bba-ab51-6a1255628be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.875928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5c50d-15bb-4bba-ab51-6a1255628be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.877630 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5c50d-15bb-4bba-ab51-6a1255628be1 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.882316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1242/2474] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:21 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:21.887057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123b398-4025-4582-8f9d-184c295c462f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.890817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1233/2475] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:21.894833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5c50d-15bb-4bba-ab51-6a1255628be1 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.897776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123b398-4025-4582-8f9d-184c295c462f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.902706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:21.904864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c7756-36bd-4873-8a17-cf5220c37e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.906064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7756-36bd-4873-8a17-cf5220c37e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.906409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7756-36bd-4873-8a17-cf5220c37e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.906635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c7756-36bd-4873-8a17-cf5220c37e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.907877 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c7756-36bd-4873-8a17-cf5220c37e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.909469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5c50d-15bb-4bba-ab51-6a1255628be1 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.910400 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c7756-36bd-4873-8a17-cf5220c37e8a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.921302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c24538-d235-4e7f-b17a-de22b9cc519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.923673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c24538-d235-4e7f-b17a-de22b9cc519b admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.923990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c24538-d235-4e7f-b17a-de22b9cc519b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.924252 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c24538-d235-4e7f-b17a-de22b9cc519b admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.925026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c24538-d235-4e7f-b17a-de22b9cc519b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.928311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1243/2476] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:21.933004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c7756-36bd-4873-8a17-cf5220c37e8a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.938263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c24538-d235-4e7f-b17a-de22b9cc519b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.948564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c7756-36bd-4873-8a17-cf5220c37e8a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.952078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1234/2477] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:21.955941 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c24538-d235-4e7f-b17a-de22b9cc519b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.956327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53049668-966e-4210-90ca-16cdb1bf6b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.957080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049668-966e-4210-90ca-16cdb1bf6b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.957503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049668-966e-4210-90ca-16cdb1bf6b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.957994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049668-966e-4210-90ca-16cdb1bf6b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.959489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53049668-966e-4210-90ca-16cdb1bf6b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.961228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53049668-966e-4210-90ca-16cdb1bf6b60 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:21.968453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c24538-d235-4e7f-b17a-de22b9cc519b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.973207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1244/2478] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:21.973365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe64989-2249-4ef8-8df9-5bccafe1580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.975255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe64989-2249-4ef8-8df9-5bccafe1580f admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.975758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe64989-2249-4ef8-8df9-5bccafe1580f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.976014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe64989-2249-4ef8-8df9-5bccafe1580f admin admin] PATH_INFO: `/v3/projects/bf498711a4e24d7eb19d6489ad6889da/users/31504fe4232e4cdea904235c2472e357/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.977718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53049668-966e-4210-90ca-16cdb1bf6b60 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:21.988749 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53049668-966e-4210-90ca-16cdb1bf6b60 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:21.994840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe64989-2249-4ef8-8df9-5bccafe1580f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf498711a4e24d7eb19d6489ad6889da, user_id=31504fe4232e4cdea904235c2472e357, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:21.995621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6207-a90a-4f50-9124-f0252883c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:21.996716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6207-a90a-4f50-9124-f0252883c956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:21.997160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6207-a90a-4f50-9124-f0252883c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:21.997411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6207-a90a-4f50-9124-f0252883c956 admin admin] PATH_INFO: `/v3/projects/26dde39423224c57b71005a60dacbed3/users/fc83928b1a17490086c5698735ed5646/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:21.998475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe64989-2249-4ef8-8df9-5bccafe1580f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.018934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca6207-a90a-4f50-9124-f0252883c956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26dde39423224c57b71005a60dacbed3, user_id=fc83928b1a17490086c5698735ed5646, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:22.022580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca6207-a90a-4f50-9124-f0252883c956 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.030302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1235/2479] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:21 2022] PUT /identity/v3/projects/bf498711a4e24d7eb19d6489ad6889da/users/31504fe4232e4cdea904235c2472e357/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:22.032255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd346db-b8d7-4d93-be76-309a5b2ed61e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.032618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd346db-b8d7-4d93-be76-309a5b2ed61e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.032994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd346db-b8d7-4d93-be76-309a5b2ed61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.040576 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1245/2480] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:21 2022] PUT /identity/v3/projects/26dde39423224c57b71005a60dacbed3/users/fc83928b1a17490086c5698735ed5646/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:22.045566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ead7-70e0-45e9-87a9-b8329061a776 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.045993 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ead7-70e0-45e9-87a9-b8329061a776 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.046350 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ead7-70e0-45e9-87a9-b8329061a776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.063607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-edd346db-b8d7-4d93-be76-309a5b2ed61e None None] MFA Rules not processed for user `31504fe4232e4cdea904235c2472e357`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:22.064862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-edd346db-b8d7-4d93-be76-309a5b2ed61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:22.067812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fe60ead7-70e0-45e9-87a9-b8329061a776 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:22.071692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fe60ead7-70e0-45e9-87a9-b8329061a776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:22.151620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1246/2481] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:22.160076 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ead7-70e0-45e9-87a9-b8329061a776 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:22.160655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1236/2482] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:22.165268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd346db-b8d7-4d93-be76-309a5b2ed61e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:22.165438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fe60ead7-70e0-45e9-87a9-b8329061a776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:22.176665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:22.180139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd346db-b8d7-4d93-be76-309a5b2ed61e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:22.187146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31196cf8-12c4-42b2-a175-d2a07d1832ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:22.187916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31196cf8-12c4-42b2-a175-d2a07d1832ab admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.188738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31196cf8-12c4-42b2-a175-d2a07d1832ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.189025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31196cf8-12c4-42b2-a175-d2a07d1832ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.190015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31196cf8-12c4-42b2-a175-d2a07d1832ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:22.192797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31196cf8-12c4-42b2-a175-d2a07d1832ab admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.229219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1237/2483] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:22 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:22.233673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31196cf8-12c4-42b2-a175-d2a07d1832ab admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:22.236032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ead7-70e0-45e9-87a9-b8329061a776 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:22.320996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d9037-3025-4a4f-ba9f-6fbd92a3741e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:22.321968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d9037-3025-4a4f-ba9f-6fbd92a3741e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.322544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d9037-3025-4a4f-ba9f-6fbd92a3741e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.322841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d9037-3025-4a4f-ba9f-6fbd92a3741e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.334028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31196cf8-12c4-42b2-a175-d2a07d1832ab admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:22.350174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d9037-3025-4a4f-ba9f-6fbd92a3741e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:22.352092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d9037-3025-4a4f-ba9f-6fbd92a3741e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.358472 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fdbc3-a823-4dc8-9fa7-1733006d3217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:22.359166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fdbc3-a823-4dc8-9fa7-1733006d3217 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.359457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fdbc3-a823-4dc8-9fa7-1733006d3217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.359742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fdbc3-a823-4dc8-9fa7-1733006d3217 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.360574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fdbc3-a823-4dc8-9fa7-1733006d3217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:22.362697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fdbc3-a823-4dc8-9fa7-1733006d3217 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.382501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1247/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:15:22.398725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d9037-3025-4a4f-ba9f-6fbd92a3741e service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:22.405940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1238/2485] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:22 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:22.417586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d9037-3025-4a4f-ba9f-6fbd92a3741e service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:22.424220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fc4a5-6955-4458-a283-06e52c44a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:22.424854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc4a5-6955-4458-a283-06e52c44a397 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.425278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc4a5-6955-4458-a283-06e52c44a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.425667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc4a5-6955-4458-a283-06e52c44a397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.426554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fc4a5-6955-4458-a283-06e52c44a397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:22.428499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fc4a5-6955-4458-a283-06e52c44a397 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.446440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fdbc3-a823-4dc8-9fa7-1733006d3217 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:22.460445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1248/2486] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:22.461058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fdbc3-a823-4dc8-9fa7-1733006d3217 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:22.466728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ddba-e864-44a7-ba75-19679fa8de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:22.468241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ddba-e864-44a7-ba75-19679fa8de0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.468531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ddba-e864-44a7-ba75-19679fa8de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.468815 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3ddba-e864-44a7-ba75-19679fa8de0a admin admin] PATH_INFO: `/v3/projects/da01d766c80e4491b1d6a7aa8f7d6871/users/d29b505df2ac43dbad78d412601e5741/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.493328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3ddba-e864-44a7-ba75-19679fa8de0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da01d766c80e4491b1d6a7aa8f7d6871, user_id=d29b505df2ac43dbad78d412601e5741, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:22.498710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3ddba-e864-44a7-ba75-19679fa8de0a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.516799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:22.530992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1239/2487] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:22 2022] PUT /identity/v3/projects/da01d766c80e4491b1d6a7aa8f7d6871/users/d29b505df2ac43dbad78d412601e5741/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:22.552969 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fc4a5-6955-4458-a283-06e52c44a397 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:22.584311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fc4a5-6955-4458-a283-06e52c44a397 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:22.685075 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078adb3-3b3b-4a90-9ee2-74927b78526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:22.688466 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078adb3-3b3b-4a90-9ee2-74927b78526a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.688911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078adb3-3b3b-4a90-9ee2-74927b78526a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.689204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078adb3-3b3b-4a90-9ee2-74927b78526a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.690347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078adb3-3b3b-4a90-9ee2-74927b78526a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:22.692797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078adb3-3b3b-4a90-9ee2-74927b78526a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.714823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ddba-e864-44a7-ba75-19679fa8de0a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:22.727467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1249/2488] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:22.730539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3ddba-e864-44a7-ba75-19679fa8de0a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:22.736803 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:22.737752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.738239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.738707 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] PATH_INFO: `/v3/projects/da01d766c80e4491b1d6a7aa8f7d6871/users/d29b505df2ac43dbad78d412601e5741/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.741623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da01d766c80e4491b1d6a7aa8f7d6871, user_id=d29b505df2ac43dbad78d412601e5741, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:22.745506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:22.769705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75fd99-d503-493e-96dd-514cc74260b1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:22.770292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75fd99-d503-493e-96dd-514cc74260b1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:22.770584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75fd99-d503-493e-96dd-514cc74260b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:22.772289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1240/2489] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:22 2022] PUT /identity/v3/projects/da01d766c80e4491b1d6a7aa8f7d6871/users/d29b505df2ac43dbad78d412601e5741/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:22.904867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ff75fd99-d503-493e-96dd-514cc74260b1 None None] MFA Rules not processed for user `d29b505df2ac43dbad78d412601e5741`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:22.907249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ff75fd99-d503-493e-96dd-514cc74260b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:23.026453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:23.089456 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1250/2490] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:23.101374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:23.103316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:23.224414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac99175-a758-42c3-acfb-f9f86af52b74 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:23.232642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:23.233451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:23.233954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:23.234238 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:23.255633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:23.259535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:23.280718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1241/2491] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:23.349742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75fd99-d503-493e-96dd-514cc74260b1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:23.360095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75fd99-d503-493e-96dd-514cc74260b1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:23.366255 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8d2f2-750f-4cc3-8688-54b63e3b1b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:23.366826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d2f2-750f-4cc3-8688-54b63e3b1b09 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:23.367110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d2f2-750f-4cc3-8688-54b63e3b1b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:23.367388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d2f2-750f-4cc3-8688-54b63e3b1b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:23.488854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8d2f2-750f-4cc3-8688-54b63e3b1b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:23.490636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8d2f2-750f-4cc3-8688-54b63e3b1b09 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:23.507893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1251/2492] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:24.768209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:24.770070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:25.067423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb34f50-e41d-4ba9-b615-2152a23d414f service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:25.083145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d12da-7196-4df2-a3fb-96615a84b0ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:25.084629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d12da-7196-4df2-a3fb-96615a84b0ea service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:25.084929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d12da-7196-4df2-a3fb-96615a84b0ea service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:25.085215 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d12da-7196-4df2-a3fb-96615a84b0ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:25.091450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5d6d12da-7196-4df2-a3fb-96615a84b0ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:25.114592 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d12da-7196-4df2-a3fb-96615a84b0ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:25.117092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d12da-7196-4df2-a3fb-96615a84b0ea service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:25.156308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1242/2493] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:27.491306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8d2f2-750f-4cc3-8688-54b63e3b1b09 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:27.667554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8d2f2-750f-4cc3-8688-54b63e3b1b09 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:27.674333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:27.676419 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:27.676703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:27.677135 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] PATH_INFO: `/v3/users/f5627e1d80cb48c6941032832412ef7d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:27.700770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5627e1d80cb48c6941032832412ef7d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:27.704816 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:27.801242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5627e1d80cb48c6941032832412ef7d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:27.801242 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5627e1d80cb48c6941032832412ef7d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:27.806294 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5627e1d80cb48c6941032832412ef7d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:27.833555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5627e1d80cb48c6941032832412ef7d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:27.856629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:27.869381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5627e1d80cb48c6941032832412ef7d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:27.875265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1252/2494] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:27 2022] DELETE /identity/v3/users/f5627e1d80cb48c6941032832412ef7d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:27.879984 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52252d-15a2-46f2-8280-a7526746c237 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:27.880727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52252d-15a2-46f2-8280-a7526746c237 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:27.884297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52252d-15a2-46f2-8280-a7526746c237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:27.926014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1c52252d-15a2-46f2-8280-a7526746c237 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:27.926014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1c52252d-15a2-46f2-8280-a7526746c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:28.051106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:28.069595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1243/2495] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:28.085194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:28.086704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:28.211869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b610d80-92a9-4a2c-8425-7dc2ff290959 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:28.217233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f791-9c2a-47e1-b4b8-6b318579fb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:28.218279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f791-9c2a-47e1-b4b8-6b318579fb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:28.218935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f791-9c2a-47e1-b4b8-6b318579fb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:28.219499 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f791-9c2a-47e1-b4b8-6b318579fb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:28.237559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920f791-9c2a-47e1-b4b8-6b318579fb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:28.239336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920f791-9c2a-47e1-b4b8-6b318579fb43 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:28.265939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1253/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:29.105756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52252d-15a2-46f2-8280-a7526746c237 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:29.107957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1c52252d-15a2-46f2-8280-a7526746c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:29.128920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52252d-15a2-46f2-8280-a7526746c237 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:29.144298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:29.145232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:29.145517 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:29.146075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] PATH_INFO: `/v3/projects/fb865ff0b41a41c58ba76baefaef8bcc` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:29.147546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb865ff0b41a41c58ba76baefaef8bcc)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:29.149563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:29.290760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb865ff0b41a41c58ba76baefaef8bcc', 'request_id': 'req-3a798ab0-f0df-4ea3-8254-82fa99a72741'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.311997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb865ff0b41a41c58ba76baefaef8bcc', 'request_id': 'req-3a798ab0-f0df-4ea3-8254-82fa99a72741'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.320878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb865ff0b41a41c58ba76baefaef8bcc', 'request_id': 'req-3a798ab0-f0df-4ea3-8254-82fa99a72741'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.347827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] The token cache is being invalidate because project fb865ff0b41a41c58ba76baefaef8bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:29.348372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.356072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.358518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1244/2497] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:29 2022] DELETE /identity/v3/projects/fb865ff0b41a41c58ba76baefaef8bcc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:29.362517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f791-9c2a-47e1-b4b8-6b318579fb43 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:29.377105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f791-9c2a-47e1-b4b8-6b318579fb43 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:29.461729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:29.462904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:29.463190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:29.463712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] PATH_INFO: `/v3/users/31504fe4232e4cdea904235c2472e357` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:29.465553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31504fe4232e4cdea904235c2472e357)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:29.469298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:29.556426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31504fe4232e4cdea904235c2472e357'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.557675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31504fe4232e4cdea904235c2472e357'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.576916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31504fe4232e4cdea904235c2472e357'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.596661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31504fe4232e4cdea904235c2472e357'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.652671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31504fe4232e4cdea904235c2472e357'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:29.678395 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1254/2498] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:29 2022] DELETE /identity/v3/users/31504fe4232e4cdea904235c2472e357 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:30.181342 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:30.183959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:30.208508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a798ab0-f0df-4ea3-8254-82fa99a72741 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:30.405263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:30.406659 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:30.407220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:30.407710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] PATH_INFO: `/v3/projects/bf498711a4e24d7eb19d6489ad6889da` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:30.410514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf498711a4e24d7eb19d6489ad6889da)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:30.422807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:30.538902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf498711a4e24d7eb19d6489ad6889da', 'request_id': 'req-9df0bbbc-5568-4749-bc96-83af405084a6'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.553510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf498711a4e24d7eb19d6489ad6889da', 'request_id': 'req-9df0bbbc-5568-4749-bc96-83af405084a6'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.565148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf498711a4e24d7eb19d6489ad6889da', 'request_id': 'req-9df0bbbc-5568-4749-bc96-83af405084a6'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.590950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] The token cache is being invalidate because project bf498711a4e24d7eb19d6489ad6889da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:30.591402 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.592239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.594086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1245/2499] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:30 2022] DELETE /identity/v3/projects/bf498711a4e24d7eb19d6489ad6889da => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:30.598365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:30.600664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:30.627278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbdac6-52f3-48d1-a56f-513c17e3be7b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:30.666812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:30.781861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:30.783196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:30.783649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:30.784070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] PATH_INFO: `/v3/users/d29b505df2ac43dbad78d412601e5741` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:30.785616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29b505df2ac43dbad78d412601e5741)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:30.787830 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:30.861062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29b505df2ac43dbad78d412601e5741'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.862284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29b505df2ac43dbad78d412601e5741'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.875371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29b505df2ac43dbad78d412601e5741'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.885853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29b505df2ac43dbad78d412601e5741'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.901276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-082950bc-d49e-4569-984e-f4e40e07f4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29b505df2ac43dbad78d412601e5741'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:30.913010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1255/2500] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:30 2022] DELETE /identity/v3/users/d29b505df2ac43dbad78d412601e5741 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:31.476016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:31.479971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:31.512582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0bbbc-5568-4749-bc96-83af405084a6 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:31.525573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:31.665435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:31.666257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:31.666546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:31.666818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] PATH_INFO: `/v3/projects/da01d766c80e4491b1d6a7aa8f7d6871` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:31.668073 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da01d766c80e4491b1d6a7aa8f7d6871)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:31.671086 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:31.754475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a0630-50ae-4cd3-80b8-a1a91fa4598f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:31.755047 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a0630-50ae-4cd3-80b8-a1a91fa4598f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:31.755140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a0630-50ae-4cd3-80b8-a1a91fa4598f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:31.796157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da01d766c80e4491b1d6a7aa8f7d6871', 'request_id': 'req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:31.804477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da01d766c80e4491b1d6a7aa8f7d6871', 'request_id': 'req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:31.813477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da01d766c80e4491b1d6a7aa8f7d6871', 'request_id': 'req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:31.860081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] The token cache is being invalidate because project da01d766c80e4491b1d6a7aa8f7d6871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:31.861250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:31.864766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-fbbb15ae-8c03-4d88-81b7-3b56dbec060a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:31.873204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1246/2501] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:31 2022] DELETE /identity/v3/projects/da01d766c80e4491b1d6a7aa8f7d6871 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:31.881768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047093b-6855-44b7-a5ec-a0c775b627a5 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:31.882680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047093b-6855-44b7-a5ec-a0c775b627a5 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:31.885063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047093b-6855-44b7-a5ec-a0c775b627a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:31.905832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-002a0630-50ae-4cd3-80b8-a1a91fa4598f None None] MFA Rules not processed for user `fc83928b1a17490086c5698735ed5646`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:31.907335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-002a0630-50ae-4cd3-80b8-a1a91fa4598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:31.985838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9047093b-6855-44b7-a5ec-a0c775b627a5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:31.988091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9047093b-6855-44b7-a5ec-a0c775b627a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:32.104056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1256/2502] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:32.105114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a0630-50ae-4cd3-80b8-a1a91fa4598f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:32.109374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-002a0630-50ae-4cd3-80b8-a1a91fa4598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:32.175932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:32.200759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1247/2503] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:15:32.210247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6dbf-e91b-4ece-867c-e3a8dc0fe1f9 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:32.210532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6dbf-e91b-4ece-867c-e3a8dc0fe1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:32.210801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e6dbf-e91b-4ece-867c-e3a8dc0fe1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:32.261672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-0f1e6dbf-e91b-4ece-867c-e3a8dc0fe1f9 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:32.262985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0f1e6dbf-e91b-4ece-867c-e3a8dc0fe1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:32.273695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a0630-50ae-4cd3-80b8-a1a91fa4598f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:32.283782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1248/2504] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:32.284585 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e6dbf-e91b-4ece-867c-e3a8dc0fe1f9 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:32.292259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aac8c9-0a15-4768-a685-b5b4b7329576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:32.293177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aac8c9-0a15-4768-a685-b5b4b7329576 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:32.293615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aac8c9-0a15-4768-a685-b5b4b7329576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:32.294667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aac8c9-0a15-4768-a685-b5b4b7329576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:32.295546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aac8c9-0a15-4768-a685-b5b4b7329576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:32.298295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aac8c9-0a15-4768-a685-b5b4b7329576 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:32.309503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e6dbf-e91b-4ece-867c-e3a8dc0fe1f9 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:32.326602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:32.327584 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:32.328019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:32.329059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:32.329997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:15:32.330716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:32.335193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:32.368377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1257/2505] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:32 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:15:32.374118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aac8c9-0a15-4768-a685-b5b4b7329576 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:32.386629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1249/2506] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:15:32.388136 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:32.432180 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a46a57-9dbd-4de6-9e3e-c356aaadd08b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:32.529892 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:32.674459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aac8c9-0a15-4768-a685-b5b4b7329576 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:32.684840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84149380-ec13-4adb-b7f7-f984baf7b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:32.686519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84149380-ec13-4adb-b7f7-f984baf7b3ac admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:32.687181 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84149380-ec13-4adb-b7f7-f984baf7b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:32.689035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84149380-ec13-4adb-b7f7-f984baf7b3ac admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:32.690584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84149380-ec13-4adb-b7f7-f984baf7b3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:32.694356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84149380-ec13-4adb-b7f7-f984baf7b3ac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:32.739029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15436-3ebf-46dd-97c0-305eb92edfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:32.740774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15436-3ebf-46dd-97c0-305eb92edfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:32.741115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15436-3ebf-46dd-97c0-305eb92edfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:32.741727 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae15436-3ebf-46dd-97c0-305eb92edfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:32.742482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae15436-3ebf-46dd-97c0-305eb92edfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:32.750257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae15436-3ebf-46dd-97c0-305eb92edfe0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:32.752390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1258/2507] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:32 2022] POST /identity/v3/users => generated 298 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:32.767699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84149380-ec13-4adb-b7f7-f984baf7b3ac admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:32.792619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84149380-ec13-4adb-b7f7-f984baf7b3ac admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:32.804784 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fd866-8b27-48c3-9f9c-b6246be8ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:32.805899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd866-8b27-48c3-9f9c-b6246be8ad8b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:32.806346 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd866-8b27-48c3-9f9c-b6246be8ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:32.806766 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd866-8b27-48c3-9f9c-b6246be8ad8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:32.807674 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fd866-8b27-48c3-9f9c-b6246be8ad8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:32.809607 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fd866-8b27-48c3-9f9c-b6246be8ad8b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:32.832637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1259/2508] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:32.832637 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fd866-8b27-48c3-9f9c-b6246be8ad8b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:32.835696 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1250/2509] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:32 2022] POST /identity/v3/projects => generated 383 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:32.837400 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15436-3ebf-46dd-97c0-305eb92edfe0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:32.858982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fd866-8b27-48c3-9f9c-b6246be8ad8b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:32.944306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782d54-78cd-46be-bf85-c3e202c5fe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:32.945290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782d54-78cd-46be-bf85-c3e202c5fe45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:32.945697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782d54-78cd-46be-bf85-c3e202c5fe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:32.946226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782d54-78cd-46be-bf85-c3e202c5fe45 admin admin] PATH_INFO: `/v3/projects/71166459c9b047498aa0514538f539ce/users/1fbf7bcd131e489f94595574b15bf6c5/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:32.957080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae15436-3ebf-46dd-97c0-305eb92edfe0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:32.963918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79782d54-78cd-46be-bf85-c3e202c5fe45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71166459c9b047498aa0514538f539ce, user_id=1fbf7bcd131e489f94595574b15bf6c5, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:32.965207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e587c-b0e9-44c1-9b0a-30cafbdcd363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:32.966374 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e587c-b0e9-44c1-9b0a-30cafbdcd363 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:32.966891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e587c-b0e9-44c1-9b0a-30cafbdcd363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:32.967484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e587c-b0e9-44c1-9b0a-30cafbdcd363 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:32.968597 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e587c-b0e9-44c1-9b0a-30cafbdcd363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:32.969252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79782d54-78cd-46be-bf85-c3e202c5fe45 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:32.988545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e587c-b0e9-44c1-9b0a-30cafbdcd363 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:32.999851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1260/2510] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:32 2022] PUT /identity/v3/projects/71166459c9b047498aa0514538f539ce/users/1fbf7bcd131e489f94595574b15bf6c5/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:33.003596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782d54-78cd-46be-bf85-c3e202c5fe45 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:33.028060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1251/2511] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:32 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:33.032761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e587c-b0e9-44c1-9b0a-30cafbdcd363 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:33.040245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:33.049167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e587c-b0e9-44c1-9b0a-30cafbdcd363 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:33.201736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782d54-78cd-46be-bf85-c3e202c5fe45 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:33.218645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e3630-2e74-459f-a672-39abf47036d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:33.219341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e3630-2e74-459f-a672-39abf47036d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:33.219621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e3630-2e74-459f-a672-39abf47036d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:33.219897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e3630-2e74-459f-a672-39abf47036d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:33.220328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f7b0b-c242-4d22-a86a-a49f0d4117d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:33.220634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e3630-2e74-459f-a672-39abf47036d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:33.221544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7b0b-c242-4d22-a86a-a49f0d4117d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:33.222652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e3630-2e74-459f-a672-39abf47036d5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:33.232871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7b0b-c242-4d22-a86a-a49f0d4117d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:33.233437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7b0b-c242-4d22-a86a-a49f0d4117d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:33.234473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f7b0b-c242-4d22-a86a-a49f0d4117d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:33.236373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f7b0b-c242-4d22-a86a-a49f0d4117d4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:33.240611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1252/2512] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:33.241890 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e3630-2e74-459f-a672-39abf47036d5 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:33.259641 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e3630-2e74-459f-a672-39abf47036d5 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:33.266792 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f5c93-ab51-409b-afe2-455c16229733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:33.267743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f5c93-ab51-409b-afe2-455c16229733 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:33.267872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f5c93-ab51-409b-afe2-455c16229733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:33.268149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f5c93-ab51-409b-afe2-455c16229733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:33.269169 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f5c93-ab51-409b-afe2-455c16229733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:33.271444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f5c93-ab51-409b-afe2-455c16229733 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:33.286426 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1261/2513] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:33.289843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f7b0b-c242-4d22-a86a-a49f0d4117d4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:33.294842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1253/2514] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:33.297995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f5c93-ab51-409b-afe2-455c16229733 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:33.312912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f5c93-ab51-409b-afe2-455c16229733 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:33.321518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f7b0b-c242-4d22-a86a-a49f0d4117d4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:33.328254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ac07-2fc3-4aff-9d98-a3469ee8299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:33.333839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ac07-2fc3-4aff-9d98-a3469ee8299e admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:33.333839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ac07-2fc3-4aff-9d98-a3469ee8299e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:33.333839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ac07-2fc3-4aff-9d98-a3469ee8299e admin admin] PATH_INFO: `/v3/projects/2909250aa45d4e1980eaca4a6f4bb15c/users/99c2445d639e4fd0bbd79695e049b189/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:33.342316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:33.343396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:33.343785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:33.344167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] PATH_INFO: `/v3/projects/71166459c9b047498aa0514538f539ce/users/1fbf7bcd131e489f94595574b15bf6c5/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:33.351226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71166459c9b047498aa0514538f539ce, user_id=1fbf7bcd131e489f94595574b15bf6c5, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:33.354948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ac07-2fc3-4aff-9d98-a3469ee8299e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2909250aa45d4e1980eaca4a6f4bb15c, user_id=99c2445d639e4fd0bbd79695e049b189, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:33.356559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:33.357784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ac07-2fc3-4aff-9d98-a3469ee8299e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:33.375062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:33.385192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1254/2515] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:33 2022] PUT /identity/v3/projects/2909250aa45d4e1980eaca4a6f4bb15c/users/99c2445d639e4fd0bbd79695e049b189/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:33.398660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1262/2516] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:33 2022] PUT /identity/v3/projects/71166459c9b047498aa0514538f539ce/users/1fbf7bcd131e489f94595574b15bf6c5/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:33.401022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24a7c-3f45-4cb0-813a-b50144904704 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:33.401308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24a7c-3f45-4cb0-813a-b50144904704 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:33.401580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24a7c-3f45-4cb0-813a-b50144904704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:33.433714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a1c24a7c-3f45-4cb0-813a-b50144904704 None None] MFA Rules not processed for user `99c2445d639e4fd0bbd79695e049b189`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:33.436405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a1c24a7c-3f45-4cb0-813a-b50144904704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:33.551214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1255/2517] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:33.561477 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:33.565469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:33.692257 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee01c37-d021-4089-a223-f44c4483fba1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:33.704655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab39a82-7f5e-4be8-b533-6892d70cd6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:33.705434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39a82-7f5e-4be8-b533-6892d70cd6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:33.705832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39a82-7f5e-4be8-b533-6892d70cd6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:33.706203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39a82-7f5e-4be8-b533-6892d70cd6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:33.730103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39a82-7f5e-4be8-b533-6892d70cd6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:33.732858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39a82-7f5e-4be8-b533-6892d70cd6f3 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:33.774175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1263/2518] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:33.801919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c24a7c-3f45-4cb0-813a-b50144904704 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:33.939439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c24a7c-3f45-4cb0-813a-b50144904704 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:33.956119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:33.957509 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:33.959008 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:33.959497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] PATH_INFO: `/v3/users/99c2445d639e4fd0bbd79695e049b189` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:33.961612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c2445d639e4fd0bbd79695e049b189)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:33.972857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:34.104130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c2445d639e4fd0bbd79695e049b189'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:34.122893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c2445d639e4fd0bbd79695e049b189'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:34.146821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c2445d639e4fd0bbd79695e049b189'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:34.170856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c2445d639e4fd0bbd79695e049b189'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:34.171627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c2445d639e4fd0bbd79695e049b189'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:34.192463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9b400-ce53-4884-b3c1-c31aff720521 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:34.193004 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9b400-ce53-4884-b3c1-c31aff720521 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:34.193724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9b400-ce53-4884-b3c1-c31aff720521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:34.195211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1256/2519] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:33 2022] DELETE /identity/v3/users/99c2445d639e4fd0bbd79695e049b189 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:34.236336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ebd9b400-ce53-4884-b3c1-c31aff720521 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:34.246046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ebd9b400-ce53-4884-b3c1-c31aff720521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:34.410736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1264/2520] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:34.431772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:34.433490 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:34.453361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:34.631495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb8740-0e3e-4241-a735-084d4665fdcb admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:34.640357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf48f4-6aba-4b5d-a652-dc2febf4547d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:34.641224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf48f4-6aba-4b5d-a652-dc2febf4547d service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:34.641510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf48f4-6aba-4b5d-a652-dc2febf4547d service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:34.641785 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf48f4-6aba-4b5d-a652-dc2febf4547d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:34.683164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf48f4-6aba-4b5d-a652-dc2febf4547d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:34.686354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf48f4-6aba-4b5d-a652-dc2febf4547d service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:34.728330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1257/2521] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:35.413410 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9b400-ce53-4884-b3c1-c31aff720521 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:35.416694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ebd9b400-ce53-4884-b3c1-c31aff720521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:35.453577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9b400-ce53-4884-b3c1-c31aff720521 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:35.469924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:35.471052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:35.477233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:35.477945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] PATH_INFO: `/v3/projects/2909250aa45d4e1980eaca4a6f4bb15c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:35.479594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2909250aa45d4e1980eaca4a6f4bb15c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:35.481918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:35.586523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:35.603440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2909250aa45d4e1980eaca4a6f4bb15c', 'request_id': 'req-1a2c5534-57e6-4dd0-8af6-d2a34343908b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:35.614352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2909250aa45d4e1980eaca4a6f4bb15c', 'request_id': 'req-1a2c5534-57e6-4dd0-8af6-d2a34343908b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:35.632095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2909250aa45d4e1980eaca4a6f4bb15c', 'request_id': 'req-1a2c5534-57e6-4dd0-8af6-d2a34343908b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:35.669970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] The token cache is being invalidate because project 2909250aa45d4e1980eaca4a6f4bb15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:35.673296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:35.674383 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a2c5534-57e6-4dd0-8af6-d2a34343908b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:35.677508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1265/2522] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:35 2022] DELETE /identity/v3/projects/2909250aa45d4e1980eaca4a6f4bb15c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:35.682611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d013dd-23ec-40e2-8b3f-1a36522a0b3f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:35.683462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d013dd-23ec-40e2-8b3f-1a36522a0b3f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:35.683913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d013dd-23ec-40e2-8b3f-1a36522a0b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:35.723877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-75d013dd-23ec-40e2-8b3f-1a36522a0b3f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:35.726619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-75d013dd-23ec-40e2-8b3f-1a36522a0b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:35.842096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1258/2523] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:35.851950 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272979-0af5-4e03-844c-9e44ead53db1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:35.852532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272979-0af5-4e03-844c-9e44ead53db1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:35.852915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272979-0af5-4e03-844c-9e44ead53db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:35.904974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a4272979-0af5-4e03-844c-9e44ead53db1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:35.907338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a4272979-0af5-4e03-844c-9e44ead53db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:35.930841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1266/2524] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:35.932593 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d013dd-23ec-40e2-8b3f-1a36522a0b3f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:35.947445 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d013dd-23ec-40e2-8b3f-1a36522a0b3f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:35.955721 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:35.959699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:35.960308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:35.961166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:35.962772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:15:35.963499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:35.966227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:36.005719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1259/2525] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:15:36.010222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272979-0af5-4e03-844c-9e44ead53db1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:36.024503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272979-0af5-4e03-844c-9e44ead53db1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:36.038348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559a88-dc69-498b-8444-7d301481b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:36.040125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559a88-dc69-498b-8444-7d301481b1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:36.042365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559a88-dc69-498b-8444-7d301481b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:36.043132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559a88-dc69-498b-8444-7d301481b1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:36.044796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7559a88-dc69-498b-8444-7d301481b1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:36.048226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7559a88-dc69-498b-8444-7d301481b1a8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:36.103157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1267/2526] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:15:36 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:15:36.108272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:36.131029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa373b-03df-4917-9df3-2bbb06d19572 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:36.460049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f3c6f-03a2-4680-b8d0-78f00e998d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:36.463909 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f3c6f-03a2-4680-b8d0-78f00e998d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:36.464516 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f3c6f-03a2-4680-b8d0-78f00e998d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:36.464757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f3c6f-03a2-4680-b8d0-78f00e998d64 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:36.466699 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f3c6f-03a2-4680-b8d0-78f00e998d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:36.486559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f3c6f-03a2-4680-b8d0-78f00e998d64 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:36.554717 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1260/2527] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:15:36 2022] POST /identity/v3/users => generated 282 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:15:36.558548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559a88-dc69-498b-8444-7d301481b1a8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:36.580156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559a88-dc69-498b-8444-7d301481b1a8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:36.593272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e1272-2de7-41fc-a9e1-2a7397185404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:36.597873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e1272-2de7-41fc-a9e1-2a7397185404 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:36.598673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e1272-2de7-41fc-a9e1-2a7397185404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:36.599166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e1272-2de7-41fc-a9e1-2a7397185404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:36.600324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e1272-2de7-41fc-a9e1-2a7397185404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:36.604039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e1272-2de7-41fc-a9e1-2a7397185404 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:36.633892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1268/2528] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:36.638482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f3c6f-03a2-4680-b8d0-78f00e998d64 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:36.658407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f3c6f-03a2-4680-b8d0-78f00e998d64 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:36.672753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc88e-db33-42ca-be86-cd996faec5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:36.674564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc88e-db33-42ca-be86-cd996faec5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:36.675165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc88e-db33-42ca-be86-cd996faec5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:36.675667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc88e-db33-42ca-be86-cd996faec5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:36.677102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bc88e-db33-42ca-be86-cd996faec5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:36.693741 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bc88e-db33-42ca-be86-cd996faec5f7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:36.717100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1261/2529] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:15:36.722370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e1272-2de7-41fc-a9e1-2a7397185404 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:36.743157 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e1272-2de7-41fc-a9e1-2a7397185404 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:36.758366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:36.759390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:36.759735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:36.760081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] PATH_INFO: `/v3/projects/872af7edd3aa400f929dc75fe824323c/users/7e0bc23f08b54a73876590d0763fa0b1/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:36.801920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872af7edd3aa400f929dc75fe824323c, user_id=7e0bc23f08b54a73876590d0763fa0b1, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:36.804620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:36.829764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1269/2530] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:15:36 2022] PUT /identity/v3/projects/872af7edd3aa400f929dc75fe824323c/users/7e0bc23f08b54a73876590d0763fa0b1/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:36.842983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ca7c-3600-4a68-9a92-86a928af527a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:36.844731 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ca7c-3600-4a68-9a92-86a928af527a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:36.845024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ca7c-3600-4a68-9a92-86a928af527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:36.903726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b522ca7c-3600-4a68-9a92-86a928af527a None None] MFA Rules not processed for user `7e0bc23f08b54a73876590d0763fa0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:36.905406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b522ca7c-3600-4a68-9a92-86a928af527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:36.914974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:37.064919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1262/2531] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:37.077067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:37.079141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:37.213502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308658b2-4a74-4e02-a2c8-ee743ce43de3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:37.218673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:37.219526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:37.219995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:37.220579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:37.233052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:37.234781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:37.261161 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1270/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:41.658272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2534ec5-8900-4870-9848-99ad0bd12eb2 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:41.659758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2534ec5-8900-4870-9848-99ad0bd12eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:41.661173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2534ec5-8900-4870-9848-99ad0bd12eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:41.715117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b2534ec5-8900-4870-9848-99ad0bd12eb2 None None] MFA Rules not processed for user `1fbf7bcd131e489f94595574b15bf6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:41.716718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b2534ec5-8900-4870-9848-99ad0bd12eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:41.837171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1263/2533] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:41.852238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:41.853803 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:41.958526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:41.977000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ee28-889d-4b2f-bb47-5f6ad422e425 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:41.984589 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c211cd37d7f49eaa916d332580135c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:41.985771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:41.986638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:41.987270 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:41.989883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:42.131372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:42.135635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:42.151375 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1271/2534] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:42.436454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a66ff-620c-4684-8c97-41afbcf2365e None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:42.436800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a66ff-620c-4684-8c97-41afbcf2365e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:42.437297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a66ff-620c-4684-8c97-41afbcf2365e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:42.576005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-637a66ff-620c-4684-8c97-41afbcf2365e None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:42.583216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-637a66ff-620c-4684-8c97-41afbcf2365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:42.666360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1264/2535] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:15:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:15:42.679296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:42.680841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:42.789833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e512-dcc4-45fd-b318-30a7f40508c8 service glance] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:42.795896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389d87-5ac2-402e-9993-0f9df0543ccb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:42.796568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389d87-5ac2-402e-9993-0f9df0543ccb service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:42.796851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389d87-5ac2-402e-9993-0f9df0543ccb service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:42.797128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389d87-5ac2-402e-9993-0f9df0543ccb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:42.807128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389d87-5ac2-402e-9993-0f9df0543ccb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:42.808663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389d87-5ac2-402e-9993-0f9df0543ccb service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:42.818052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1272/2536] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:15:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:15:43.813393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b540-1aeb-4130-98f8-83b1f02ab3fd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:43.813942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b540-1aeb-4130-98f8-83b1f02ab3fd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:43.814064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b540-1aeb-4130-98f8-83b1f02ab3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:43.823554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:43.836902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-6403b540-1aeb-4130-98f8-83b1f02ab3fd None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:43.839763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6403b540-1aeb-4130-98f8-83b1f02ab3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:43.851355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1265/2537] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 23 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:43.864961 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389d87-5ac2-402e-9993-0f9df0543ccb service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:43.883342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389d87-5ac2-402e-9993-0f9df0543ccb service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:43.897339 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:43.898314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:43.898728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:43.898894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:43.919464 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:43.921092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:43.934191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1273/2538] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:15:46.712113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd6f6b-30d4-493c-8d8a-bc1febc61d37 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:46.712612 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd6f6b-30d4-493c-8d8a-bc1febc61d37 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:46.712712 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd6f6b-30d4-493c-8d8a-bc1febc61d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:46.740054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-64fd6f6b-30d4-493c-8d8a-bc1febc61d37 None None] MFA Rules not processed for user `d21524f4232648ebaed76e1d7d5daf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:46.741434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-64fd6f6b-30d4-493c-8d8a-bc1febc61d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:46.839611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1266/2539] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:46.973690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:46.975742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:47.104910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:47.123625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800265-5e29-4399-8d02-f2ff3bf43326 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:47.138998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:47.141121 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:47.144771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:47.145056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] PATH_INFO: `/v3/users/89d1af25b199404b9f432b21c825b447` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:47.151572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d1af25b199404b9f432b21c825b447)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:47.153583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:47.274223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d1af25b199404b9f432b21c825b447'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.276188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d1af25b199404b9f432b21c825b447'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.313478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d1af25b199404b9f432b21c825b447'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.348683 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d1af25b199404b9f432b21c825b447'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.406301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d1af25b199404b9f432b21c825b447'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.427582 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1274/2540] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:15:46 2022] DELETE /identity/v3/users/89d1af25b199404b9f432b21c825b447 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:47.697553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd6f6b-30d4-493c-8d8a-bc1febc61d37 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:47.715633 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd6f6b-30d4-493c-8d8a-bc1febc61d37 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:47.840810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:47.842152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:47.842642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:47.843120 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] PATH_INFO: `/v3/projects/aa636b31dd844b93b83300a3de1418ce` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:47.844566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa636b31dd844b93b83300a3de1418ce)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:47.848511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:47.934352 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa636b31dd844b93b83300a3de1418ce', 'request_id': 'req-6fc1d666-4794-429e-bb19-d1e09ef685a3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.945442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa636b31dd844b93b83300a3de1418ce', 'request_id': 'req-6fc1d666-4794-429e-bb19-d1e09ef685a3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.956905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa636b31dd844b93b83300a3de1418ce', 'request_id': 'req-6fc1d666-4794-429e-bb19-d1e09ef685a3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.987405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] The token cache is being invalidate because project aa636b31dd844b93b83300a3de1418ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:15:47.990024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.991801 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6fc1d666-4794-429e-bb19-d1e09ef685a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:15:47.994799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1267/2541] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:15:47 2022] DELETE /identity/v3/projects/aa636b31dd844b93b83300a3de1418ce => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:15:49.539103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:15:49.540667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:49.662783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0b109-bc3c-4178-9b97-fe51acb7bfa4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:15:49.745594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722389db-9bb6-4884-bffb-c4dfabaa761e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:15:49.746605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722389db-9bb6-4884-bffb-c4dfabaa761e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:49.747057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722389db-9bb6-4884-bffb-c4dfabaa761e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:49.747485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722389db-9bb6-4884-bffb-c4dfabaa761e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:49.749645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-722389db-9bb6-4884-bffb-c4dfabaa761e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:49.819920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:49.871829 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722389db-9bb6-4884-bffb-c4dfabaa761e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:15:49.874956 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722389db-9bb6-4884-bffb-c4dfabaa761e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:15:49.887876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1275/2542] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:15:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:15:50.747773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520608e-b252-49d3-9e76-73c1126162f0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:50.748322 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520608e-b252-49d3-9e76-73c1126162f0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:50.748420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520608e-b252-49d3-9e76-73c1126162f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:50.775068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e520608e-b252-49d3-9e76-73c1126162f0 None None] MFA Rules not processed for user `ccfccebbea724eca8909be4fea93a58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:50.778285 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e520608e-b252-49d3-9e76-73c1126162f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:50.831589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:15:50.875431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1268/2543] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:15:56.282357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbc3a-0b0a-418c-bea5-8aa27e5dcdd9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:15:56.282823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbc3a-0b0a-418c-bea5-8aa27e5dcdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:15:56.283000 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cbc3a-0b0a-418c-bea5-8aa27e5dcdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:15:56.309880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-048cbc3a-0b0a-418c-bea5-8aa27e5dcdd9 None None] MFA Rules not processed for user `fc83928b1a17490086c5698735ed5646`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:15:56.311368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-048cbc3a-0b0a-418c-bea5-8aa27e5dcdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:15:56.419136 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1276/2544] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:15:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:16:00.862302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=10 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:01.913839 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ae38-0bcf-4718-8907-d4eeffc35724 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:01.914915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ae38-0bcf-4718-8907-d4eeffc35724 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:01.915350 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ae38-0bcf-4718-8907-d4eeffc35724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:01.938932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e4a6ae38-0bcf-4718-8907-d4eeffc35724 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:16:01.940207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e4a6ae38-0bcf-4718-8907-d4eeffc35724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:02.011756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1269/2545] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:16:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:16:02.025262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cbc3a-0b0a-418c-bea5-8aa27e5dcdd9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:02.027022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-048cbc3a-0b0a-418c-bea5-8aa27e5dcdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:02.102989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cbc3a-0b0a-418c-bea5-8aa27e5dcdd9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:02.107770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f226ba-2732-4016-b4cc-add1de4e7dff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:02.108449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f226ba-2732-4016-b4cc-add1de4e7dff service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:02.108726 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f226ba-2732-4016-b4cc-add1de4e7dff service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:02.108967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f226ba-2732-4016-b4cc-add1de4e7dff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:02.119732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f226ba-2732-4016-b4cc-add1de4e7dff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:02.121351 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f226ba-2732-4016-b4cc-add1de4e7dff service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:02.129853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1277/2546] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:16:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:16:12.003783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=25 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:12.126708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=67 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:31.070656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6ae38-0bcf-4718-8907-d4eeffc35724 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:31.072570 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e4a6ae38-0bcf-4718-8907-d4eeffc35724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:31.154003 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6ae38-0bcf-4718-8907-d4eeffc35724 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:31.159075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:31.160042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:31.160324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:31.160598 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] PATH_INFO: `/v3/users/7e0bc23f08b54a73876590d0763fa0b1` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:31.161821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0bc23f08b54a73876590d0763fa0b1)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:31.164242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:31.216636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0bc23f08b54a73876590d0763fa0b1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.224852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0bc23f08b54a73876590d0763fa0b1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.239534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0bc23f08b54a73876590d0763fa0b1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.246738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0bc23f08b54a73876590d0763fa0b1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.247455 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0bc23f08b54a73876590d0763fa0b1'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.253329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1270/2547] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:16:31 2022] DELETE /identity/v3/users/7e0bc23f08b54a73876590d0763fa0b1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:16:31.259226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e58f-2547-4b30-8764-9457e664c217 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:31.259769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e58f-2547-4b30-8764-9457e664c217 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:31.259899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e58f-2547-4b30-8764-9457e664c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:31.279214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6746e58f-2547-4b30-8764-9457e664c217 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:16:31.280417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6746e58f-2547-4b30-8764-9457e664c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:31.340662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1278/2548] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:16:31.350431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:31.352392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:31.415309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61755a-62f4-4b60-bb35-87a4a9204ee9 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:31.419724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57c73c-f831-4f9c-a75b-a7e50149522f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:31.420381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c73c-f831-4f9c-a75b-a7e50149522f service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:31.420665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c73c-f831-4f9c-a75b-a7e50149522f service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:31.420940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57c73c-f831-4f9c-a75b-a7e50149522f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:31.431129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57c73c-f831-4f9c-a75b-a7e50149522f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:31.432576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57c73c-f831-4f9c-a75b-a7e50149522f service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:31.442753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1271/2549] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:16:31.727031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746e58f-2547-4b30-8764-9457e664c217 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:31.728552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6746e58f-2547-4b30-8764-9457e664c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:31.741918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746e58f-2547-4b30-8764-9457e664c217 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:31.746861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:31.747780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:31.748066 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:31.748340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] PATH_INFO: `/v3/projects/872af7edd3aa400f929dc75fe824323c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:31.749542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=872af7edd3aa400f929dc75fe824323c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:31.752676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:31.827297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872af7edd3aa400f929dc75fe824323c', 'request_id': 'req-77fadb79-3a69-47ea-a82a-174003961248'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.837480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872af7edd3aa400f929dc75fe824323c', 'request_id': 'req-77fadb79-3a69-47ea-a82a-174003961248'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.846987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872af7edd3aa400f929dc75fe824323c', 'request_id': 'req-77fadb79-3a69-47ea-a82a-174003961248'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.877819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] The token cache is being invalidate because project 872af7edd3aa400f929dc75fe824323c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:16:31.878343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.879118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-77fadb79-3a69-47ea-a82a-174003961248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:31.883431 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1279/2550] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:16:31 2022] DELETE /identity/v3/projects/872af7edd3aa400f929dc75fe824323c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:16:31.888457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2067-9cc8-4603-b1c3-7b906c2d951d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:31.888804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2067-9cc8-4603-b1c3-7b906c2d951d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:31.889081 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2067-9cc8-4603-b1c3-7b906c2d951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:31.908440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-068a2067-9cc8-4603-b1c3-7b906c2d951d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:16:31.909762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-068a2067-9cc8-4603-b1c3-7b906c2d951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:31.941242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:31.998929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1272/2551] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:16:32.006420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663a24-353d-44de-86d7-499fe06046ee None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.006971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663a24-353d-44de-86d7-499fe06046ee None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.007269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c663a24-353d-44de-86d7-499fe06046ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.032603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9c663a24-353d-44de-86d7-499fe06046ee None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:16:32.034138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9c663a24-353d-44de-86d7-499fe06046ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:32.043534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1280/2552] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:16:32.057273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a2067-9cc8-4603-b1c3-7b906c2d951d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.074949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a2067-9cc8-4603-b1c3-7b906c2d951d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.084657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.087897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.088326 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.088750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.089855 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:16:32.090247 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.092899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.108237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1273/2553] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:16:32.112158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c663a24-353d-44de-86d7-499fe06046ee None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.123213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c663a24-353d-44de-86d7-499fe06046ee None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.137650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be756d-52b9-44a6-9e9c-d0a1bd3fb72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.138591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be756d-52b9-44a6-9e9c-d0a1bd3fb72b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.138869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be756d-52b9-44a6-9e9c-d0a1bd3fb72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.139238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be756d-52b9-44a6-9e9c-d0a1bd3fb72b admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.140058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be756d-52b9-44a6-9e9c-d0a1bd3fb72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.142192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be756d-52b9-44a6-9e9c-d0a1bd3fb72b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.173918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1281/2554] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:16:32 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:16:32.176459 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.188590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31dfb7-d21a-4427-8592-66f5b7b69bc1 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.253988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff928054-110d-4110-8945-1d645c0d6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.254683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928054-110d-4110-8945-1d645c0d6c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.254963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928054-110d-4110-8945-1d645c0d6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.255634 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928054-110d-4110-8945-1d645c0d6c53 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.256002 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff928054-110d-4110-8945-1d645c0d6c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.258007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff928054-110d-4110-8945-1d645c0d6c53 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.295505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1274/2555] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:16:32 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:16:32.296798 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be756d-52b9-44a6-9e9c-d0a1bd3fb72b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.310717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be756d-52b9-44a6-9e9c-d0a1bd3fb72b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.315978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884771b4-8e5e-4097-a834-a334be6ef6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.316661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884771b4-8e5e-4097-a834-a334be6ef6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.316943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884771b4-8e5e-4097-a834-a334be6ef6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.317218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884771b4-8e5e-4097-a834-a334be6ef6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.318006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884771b4-8e5e-4097-a834-a334be6ef6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.319634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884771b4-8e5e-4097-a834-a334be6ef6a3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.339467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1282/2556] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:16:32.343559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff928054-110d-4110-8945-1d645c0d6c53 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.354076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff928054-110d-4110-8945-1d645c0d6c53 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.360378 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428423db-8a30-43c0-af54-737405b5deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.360948 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428423db-8a30-43c0-af54-737405b5deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.361226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428423db-8a30-43c0-af54-737405b5deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.362115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428423db-8a30-43c0-af54-737405b5deb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.362258 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428423db-8a30-43c0-af54-737405b5deb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.363852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428423db-8a30-43c0-af54-737405b5deb6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.374823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1275/2557] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:16:32.379468 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884771b4-8e5e-4097-a834-a334be6ef6a3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.391542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884771b4-8e5e-4097-a834-a334be6ef6a3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.399268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.400298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.400650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.400994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] PATH_INFO: `/v3/projects/737309703b084b2a93719d1362f642a0/users/b9a4979343494fa5bc156e1abb106b2a/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.419365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=737309703b084b2a93719d1362f642a0, user_id=b9a4979343494fa5bc156e1abb106b2a, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.422444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.440664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1283/2558] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:16:32 2022] PUT /identity/v3/projects/737309703b084b2a93719d1362f642a0/users/b9a4979343494fa5bc156e1abb106b2a/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:16:32.451559 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5723e-c409-47f9-9b04-5b40431736bd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.451873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5723e-c409-47f9-9b04-5b40431736bd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.452149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5723e-c409-47f9-9b04-5b40431736bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.481561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1fb5723e-c409-47f9-9b04-5b40431736bd None None] MFA Rules not processed for user `b9a4979343494fa5bc156e1abb106b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:16:32.482908 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1fb5723e-c409-47f9-9b04-5b40431736bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:32.553183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1276/2559] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:16:32.565451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.567566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:32.594043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:32.640862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f21ce-36a8-462c-9860-174c121a19ed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.644973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd908fb0-6b88-4acf-af8d-24482e073dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.645639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908fb0-6b88-4acf-af8d-24482e073dcf service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.645959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908fb0-6b88-4acf-af8d-24482e073dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.646238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908fb0-6b88-4acf-af8d-24482e073dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.655210 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd908fb0-6b88-4acf-af8d-24482e073dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.656663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd908fb0-6b88-4acf-af8d-24482e073dcf service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.669007 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1284/2560] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:16:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:16:32.686521 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5723e-c409-47f9-9b04-5b40431736bd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.688477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1fb5723e-c409-47f9-9b04-5b40431736bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:32.699769 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd908fb0-6b88-4acf-af8d-24482e073dcf service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:32.736273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:32.786026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5723e-c409-47f9-9b04-5b40431736bd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.787283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd908fb0-6b88-4acf-af8d-24482e073dcf service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:32.790790 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155cbb5-cb77-4009-9be8-cba5d7efcdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.795056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:32.796372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.797079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.797554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] PATH_INFO: `/v3/users/b9a4979343494fa5bc156e1abb106b2a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.799762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155cbb5-cb77-4009-9be8-cba5d7efcdba service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.799762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155cbb5-cb77-4009-9be8-cba5d7efcdba service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.799990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155cbb5-cb77-4009-9be8-cba5d7efcdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.801771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a4979343494fa5bc156e1abb106b2a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.802321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b155cbb5-cb77-4009-9be8-cba5d7efcdba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:32.804180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.890314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155cbb5-cb77-4009-9be8-cba5d7efcdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:32.891906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155cbb5-cb77-4009-9be8-cba5d7efcdba service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:32.894864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a4979343494fa5bc156e1abb106b2a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:32.895599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a4979343494fa5bc156e1abb106b2a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:32.902228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1277/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:16:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:16:32.905848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a4979343494fa5bc156e1abb106b2a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:32.913748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a4979343494fa5bc156e1abb106b2a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:32.936039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a4979343494fa5bc156e1abb106b2a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:32.942777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1285/2562] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:16:32 2022] DELETE /identity/v3/users/b9a4979343494fa5bc156e1abb106b2a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:16:32.947327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e794a5-584e-4d03-9084-af491229528f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:32.947617 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e794a5-584e-4d03-9084-af491229528f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:32.947891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e794a5-584e-4d03-9084-af491229528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:32.966163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-60e794a5-584e-4d03-9084-af491229528f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:16:32.967392 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-60e794a5-584e-4d03-9084-af491229528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:33.040302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1278/2563] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:16:33.052796 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:33.054300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:33.104711 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:33.120967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e480c-0e7b-4f7a-a4f3-a45d4bcab6fa admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:33.125237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff354d-b2d0-492c-9d59-608ab7e54145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:33.130598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff354d-b2d0-492c-9d59-608ab7e54145 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:33.131137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff354d-b2d0-492c-9d59-608ab7e54145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:33.131747 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff354d-b2d0-492c-9d59-608ab7e54145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:33.143871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff354d-b2d0-492c-9d59-608ab7e54145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:33.145725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff354d-b2d0-492c-9d59-608ab7e54145 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:33.158500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1286/2564] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:16:33.791825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e794a5-584e-4d03-9084-af491229528f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:33.793366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-60e794a5-584e-4d03-9084-af491229528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:33.804656 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ce4c0-169c-4228-99f9-c1f50ad14da3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:33.805661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ce4c0-169c-4228-99f9-c1f50ad14da3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:33.805661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ce4c0-169c-4228-99f9-c1f50ad14da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:33.822091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e794a5-584e-4d03-9084-af491229528f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:33.827425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:33.828581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:33.828957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:33.829414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] PATH_INFO: `/v3/projects/737309703b084b2a93719d1362f642a0` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:33.830885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737309703b084b2a93719d1362f642a0)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:33.833319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e12ce4c0-169c-4228-99f9-c1f50ad14da3 None None] MFA Rules not processed for user `fc6a4d6c1f834720a69ee30d5ae63cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:16:33.833456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:33.834750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e12ce4c0-169c-4228-99f9-c1f50ad14da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:33.890821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737309703b084b2a93719d1362f642a0', 'request_id': 'req-e581446c-2372-474c-89fd-42d74a8acb79'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:33.898273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737309703b084b2a93719d1362f642a0', 'request_id': 'req-e581446c-2372-474c-89fd-42d74a8acb79'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:33.899656 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1287/2565] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:16:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:16:33.911768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737309703b084b2a93719d1362f642a0', 'request_id': 'req-e581446c-2372-474c-89fd-42d74a8acb79'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:33.914301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:33.934636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] The token cache is being invalidate because project 737309703b084b2a93719d1362f642a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:16:33.934922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:33.935611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:16:33.937519 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1279/2566] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:16:33 2022] DELETE /identity/v3/projects/737309703b084b2a93719d1362f642a0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:16:43.891372 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=32 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:43.927546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:16:49.704327 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ce4c0-169c-4228-99f9-c1f50ad14da3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:16:49.705860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e12ce4c0-169c-4228-99f9-c1f50ad14da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:49.718485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ce4c0-169c-4228-99f9-c1f50ad14da3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:16:49.775078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:16:49.775973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:16:49.776318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:16:49.776599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:16:49.778908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:16:49.860690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:16:49.862189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:16:49.873271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1288/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:16:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:16:59.868170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=50 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:17:58.472009 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:17:58.473700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:17:58.557407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581446c-2372-474c-89fd-42d74a8acb79 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:17:58.564222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:17:58.564880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:17:58.565163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:17:58.565441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:17:58.567437 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:17:58.631143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:17:58.633619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:17:58.649251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1280/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:17:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:17:58.702631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:17:58.705042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:17:58.777392 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b56b0-7e88-44ab-9d0b-99743ffb66d3 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:17:58.781612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:17:58.782308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:17:58.782537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:17:58.782841 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:17:58.784837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:17:58.799529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:17:58.801230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:17:58.812910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1289/2569] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:17:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:07.661470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:07.663046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:07.675624 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a2db3-8603-42a1-9bd5-4176503c4de7 service nova] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:07.679338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:07.680050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:07.680328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:07.680605 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:07.682821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:07.697149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:07.699023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:07.708762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1281/2570] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:07.774235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:07.783402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f5822-e6a1-4064-87ca-d233a462407d service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:07.787635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:07.788288 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:07.788569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:07.788844 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:07.790954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:07.805527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:07.807352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:07.818935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1290/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:18:17.705565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=62 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:17.818117 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=32 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:18.290404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:18.293230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:18.313446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d652e4-492b-4c95-8705-d4b925b654d8 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:18.320229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54263f6-8154-4ebb-a1b6-f25e21eb01de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:18.320866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54263f6-8154-4ebb-a1b6-f25e21eb01de service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:18.321144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54263f6-8154-4ebb-a1b6-f25e21eb01de service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:18.321410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54263f6-8154-4ebb-a1b6-f25e21eb01de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:18.323263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f54263f6-8154-4ebb-a1b6-f25e21eb01de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:18.399702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54263f6-8154-4ebb-a1b6-f25e21eb01de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:18.401772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54263f6-8154-4ebb-a1b6-f25e21eb01de service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:18.411401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1282/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:22.326190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:22.338893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077286b-5d8f-4f8e-a52a-d3a295df4c72 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:22.346131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:22.347113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:22.347793 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:22.348435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:22.350868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:22.365677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:22.367813 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:22.379791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1291/2573] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:26.005813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185a3ed-9cee-44d3-b40f-c6d263396d93 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:26.006407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185a3ed-9cee-44d3-b40f-c6d263396d93 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:26.006407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185a3ed-9cee-44d3-b40f-c6d263396d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:26.025577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d185a3ed-9cee-44d3-b40f-c6d263396d93 None None] MFA Rules not processed for user `ccfccebbea724eca8909be4fea93a58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:18:26.026836 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d185a3ed-9cee-44d3-b40f-c6d263396d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:26.034202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1283/2574] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:18:31.480112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:31.494298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a3198-6542-4f16-9d31-721f943630c2 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:31.499664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:31.500314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:31.500595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:31.500865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:31.502658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:31.515435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:31.517064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:31.528370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1292/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:35.581182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9e35a-bc2f-40c7-99d5-f2fb3ea7e46f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:35.582235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9e35a-bc2f-40c7-99d5-f2fb3ea7e46f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:35.582520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9e35a-bc2f-40c7-99d5-f2fb3ea7e46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:35.601551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-5cb9e35a-bc2f-40c7-99d5-f2fb3ea7e46f None None] MFA Rules not processed for user `fc6a4d6c1f834720a69ee30d5ae63cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:18:35.602813 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5cb9e35a-bc2f-40c7-99d5-f2fb3ea7e46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:35.610676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1284/2576] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:18:35.944359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:35.954592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f5201-a89d-429e-ae04-a7e44e98a3de service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:35.958647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571325cc-b50a-4066-9f08-b4e0ddd971e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:35.959409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571325cc-b50a-4066-9f08-b4e0ddd971e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:35.959689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571325cc-b50a-4066-9f08-b4e0ddd971e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:35.959960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571325cc-b50a-4066-9f08-b4e0ddd971e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:35.962482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-571325cc-b50a-4066-9f08-b4e0ddd971e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:35.972802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571325cc-b50a-4066-9f08-b4e0ddd971e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:35.974304 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571325cc-b50a-4066-9f08-b4e0ddd971e6 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:35.982802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1293/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:38.347142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9e35a-bc2f-40c7-99d5-f2fb3ea7e46f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:38.349167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5cb9e35a-bc2f-40c7-99d5-f2fb3ea7e46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:38.432351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9e35a-bc2f-40c7-99d5-f2fb3ea7e46f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:38.438329 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dcf57-729b-4465-bffa-c6e0109f3a21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:38.438974 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dcf57-729b-4465-bffa-c6e0109f3a21 service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:38.439256 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dcf57-729b-4465-bffa-c6e0109f3a21 service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:38.439543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dcf57-729b-4465-bffa-c6e0109f3a21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:38.441616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6c6dcf57-729b-4465-bffa-c6e0109f3a21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:38.454995 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dcf57-729b-4465-bffa-c6e0109f3a21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:38.456680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dcf57-729b-4465-bffa-c6e0109f3a21 service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:38.467028 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1285/2578] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:45.979063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=18 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:47.873518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328fe4-56b9-4782-b837-5e9f994fff83 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:47.874277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328fe4-56b9-4782-b837-5e9f994fff83 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:47.874277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328fe4-56b9-4782-b837-5e9f994fff83 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:47.875495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1294/2579] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:18:47.882306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b58b-ff90-45bd-8e97-1c9e520596a0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:47.882833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b58b-ff90-45bd-8e97-1c9e520596a0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:47.882833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b58b-ff90-45bd-8e97-1c9e520596a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:47.890108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=67 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:47.903847 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b364b58b-ff90-45bd-8e97-1c9e520596a0 None None] MFA Rules not processed for user `2a92136d53514159a22faacb60ef0c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:18:47.905087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b364b58b-ff90-45bd-8e97-1c9e520596a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:47.912128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1286/2580] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:18:47.925015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62328fe4-56b9-4782-b837-5e9f994fff83 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:47.936469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62328fe4-56b9-4782-b837-5e9f994fff83 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:47.940079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681228c6-62ea-4732-aec9-aebaedeeaa57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:47.940654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681228c6-62ea-4732-aec9-aebaedeeaa57 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:47.940931 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681228c6-62ea-4732-aec9-aebaedeeaa57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:47.941200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681228c6-62ea-4732-aec9-aebaedeeaa57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:47.948647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681228c6-62ea-4732-aec9-aebaedeeaa57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:47.950095 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681228c6-62ea-4732-aec9-aebaedeeaa57 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:47.958070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1295/2581] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:48.045220 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746ba6-b07e-4f47-b7af-8784adc3037f None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:48.045504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746ba6-b07e-4f47-b7af-8784adc3037f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:48.045810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746ba6-b07e-4f47-b7af-8784adc3037f None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:48.047268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1287/2582] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:18:48.052820 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2c45-1afb-4b46-b2b7-be5ec31c76f5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:48.053108 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2c45-1afb-4b46-b2b7-be5ec31c76f5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:48.053382 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2c45-1afb-4b46-b2b7-be5ec31c76f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:48.096303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c31d2c45-1afb-4b46-b2b7-be5ec31c76f5 None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:18:48.098077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c31d2c45-1afb-4b46-b2b7-be5ec31c76f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:48.113603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1296/2583] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:18:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:18:48.129351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c746ba6-b07e-4f47-b7af-8784adc3037f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:48.146525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c746ba6-b07e-4f47-b7af-8784adc3037f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:48.151675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046983f6-b856-4b44-9558-3efd386ead08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:48.152309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046983f6-b856-4b44-9558-3efd386ead08 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:48.152580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046983f6-b856-4b44-9558-3efd386ead08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:48.152853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046983f6-b856-4b44-9558-3efd386ead08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:48.163407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046983f6-b856-4b44-9558-3efd386ead08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:48.164842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046983f6-b856-4b44-9558-3efd386ead08 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:48.175896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1288/2584] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:49.166463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2c45-1afb-4b46-b2b7-be5ec31c76f5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:18:49.177628 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2c45-1afb-4b46-b2b7-be5ec31c76f5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:18:49.184442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747a9ac-6f6a-4868-bddf-3174b4ec8518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:18:49.185175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a9ac-6f6a-4868-bddf-3174b4ec8518 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:18:49.185675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a9ac-6f6a-4868-bddf-3174b4ec8518 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:18:49.186208 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a9ac-6f6a-4868-bddf-3174b4ec8518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:18:49.188306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1747a9ac-6f6a-4868-bddf-3174b4ec8518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:18:49.201656 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747a9ac-6f6a-4868-bddf-3174b4ec8518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:18:49.203374 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747a9ac-6f6a-4868-bddf-3174b4ec8518 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:18:49.214689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1297/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:18:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:18:58.171189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=8 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:18:59.210689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=21 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:11.227114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e2296-b683-4272-a602-8549b471e2c8 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:11.227648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e2296-b683-4272-a602-8549b471e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:11.227648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e2296-b683-4272-a602-8549b471e2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:11.247466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-823e2296-b683-4272-a602-8549b471e2c8 None None] MFA Rules not processed for user `d21524f4232648ebaed76e1d7d5daf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:19:11.248680 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-823e2296-b683-4272-a602-8549b471e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:11.312263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1289/2586] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:19:21.296764 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=25 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:38.096381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcde88-0b20-42db-b495-85b3b70373a5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:38.096797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcde88-0b20-42db-b495-85b3b70373a5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:38.096900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcde88-0b20-42db-b495-85b3b70373a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:38.119386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d4fcde88-0b20-42db-b495-85b3b70373a5 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:19:38.120759 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d4fcde88-0b20-42db-b495-85b3b70373a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:38.182881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1298/2587] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 23 17:19:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:19:38.232638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e2296-b683-4272-a602-8549b471e2c8 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:38.234094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-823e2296-b683-4272-a602-8549b471e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:38.308317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e2296-b683-4272-a602-8549b471e2c8 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:38.314255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:38.314913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:38.315192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:38.315655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:38.324075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:38.325657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:38.333681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1290/2588] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:19:42.345048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcde88-0b20-42db-b495-85b3b70373a5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:42.357651 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcde88-0b20-42db-b495-85b3b70373a5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:42.363428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:42.364283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:42.364568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:42.364840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:42.366667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:42.380013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:42.381613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:42.392903 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1299/2589] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:19:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:19:46.390014 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:46.391749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:46.407119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b4ff-8f74-4ca2-a588-b90046d63bf8 service swift] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:46.414408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:46.415264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:46.415949 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:46.416368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:46.418362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:46.435284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:46.437340 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:46.450186 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1291/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:19:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:19:46.462404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:46.464369 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:46.543386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da4dec-8c78-4369-8d10-e6d3ff6b5f3e service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:46.547964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:46.548858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:46.549152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:46.549418 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] PATH_INFO: `/v3/users/fc83928b1a17490086c5698735ed5646` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:46.551013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc83928b1a17490086c5698735ed5646)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:46.552948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:46.605893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc83928b1a17490086c5698735ed5646'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:46.606538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc83928b1a17490086c5698735ed5646'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:46.615141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc83928b1a17490086c5698735ed5646'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:46.622298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc83928b1a17490086c5698735ed5646'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:46.634316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc83928b1a17490086c5698735ed5646'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:46.640243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1300/2591] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:19:46 2022] DELETE /identity/v3/users/fc83928b1a17490086c5698735ed5646 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:19:46.834665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:46.849319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3836-483b-4a55-a87e-d8a68ad814fa service placement] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:46.913406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:46.914345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:46.914604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:46.914905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] PATH_INFO: `/v3/projects/26dde39423224c57b71005a60dacbed3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:46.916094 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26dde39423224c57b71005a60dacbed3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:46.918056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:46.972532 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26dde39423224c57b71005a60dacbed3', 'request_id': 'req-2541d1ea-0e0e-45c1-af6f-02607b610287'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:46.979159 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26dde39423224c57b71005a60dacbed3', 'request_id': 'req-2541d1ea-0e0e-45c1-af6f-02607b610287'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:46.985877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26dde39423224c57b71005a60dacbed3', 'request_id': 'req-2541d1ea-0e0e-45c1-af6f-02607b610287'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.002466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] The token cache is being invalidate because project 26dde39423224c57b71005a60dacbed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:19:47.002739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.003391 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.004952 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1292/2592] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:19:46 2022] DELETE /identity/v3/projects/26dde39423224c57b71005a60dacbed3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:19:47.009119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:47.010702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:47.024626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc96ff-add0-4a88-9e29-60a87bada758 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:47.037149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:47.095521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:47.096519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:47.096805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:47.097086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] PATH_INFO: `/v3/users/1fbf7bcd131e489f94595574b15bf6c5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:47.098348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbf7bcd131e489f94595574b15bf6c5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:47.100334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:47.151285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbf7bcd131e489f94595574b15bf6c5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.151988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbf7bcd131e489f94595574b15bf6c5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.161090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbf7bcd131e489f94595574b15bf6c5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.168416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbf7bcd131e489f94595574b15bf6c5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.182925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbf7bcd131e489f94595574b15bf6c5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.190053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1301/2593] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:19:47 2022] DELETE /identity/v3/users/1fbf7bcd131e489f94595574b15bf6c5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:19:47.384129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:47.385763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:47.400645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d1ea-0e0e-45c1-af6f-02607b610287 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:47.404493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:47.463439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:47.464345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:47.464693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:47.464967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] PATH_INFO: `/v3/projects/71166459c9b047498aa0514538f539ce` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:47.466204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=71166459c9b047498aa0514538f539ce)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:47.468114 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:47.523608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71166459c9b047498aa0514538f539ce', 'request_id': 'req-a044e010-7d40-43dc-8a93-f56419cfa74e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.529577 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71166459c9b047498aa0514538f539ce', 'request_id': 'req-a044e010-7d40-43dc-8a93-f56419cfa74e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.536368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71166459c9b047498aa0514538f539ce', 'request_id': 'req-a044e010-7d40-43dc-8a93-f56419cfa74e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.551881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] The token cache is being invalidate because project 71166459c9b047498aa0514538f539ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:19:47.552171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.552804 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:47.554757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1293/2594] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:19:47 2022] DELETE /identity/v3/projects/71166459c9b047498aa0514538f539ce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:19:56.372708 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:56.374323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:56.436368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593c618-ad9c-4974-a7bd-19cc2378a5ea admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:56.481281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:56.488089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:56.488779 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:56.489087 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:56.489366 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:56.492329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:56.581061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:56.582434 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:56.596776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1302/2595] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:19:57.548456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:19:59.600251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:59.601965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:19:59.616443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044e010-7d40-43dc-8a93-f56419cfa74e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:59.620928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:59.622657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:59.622962 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:59.623240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] PATH_INFO: `/v3/users/ccfccebbea724eca8909be4fea93a58f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:59.624618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccfccebbea724eca8909be4fea93a58f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:59.626706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:19:59.689387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccfccebbea724eca8909be4fea93a58f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:59.700005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccfccebbea724eca8909be4fea93a58f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:59.712621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccfccebbea724eca8909be4fea93a58f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:59.719449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccfccebbea724eca8909be4fea93a58f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:59.720106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-011a1dc1-8544-4d2e-8690-108f02023e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccfccebbea724eca8909be4fea93a58f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:19:59.726473 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1294/2596] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:19:59 2022] DELETE /identity/v3/users/ccfccebbea724eca8909be4fea93a58f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:19:59.911035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:19:59.921495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aadc0-382f-4c36-8e7d-4f7087d51b2f service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:19:59.981046 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:19:59.981968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:19:59.982235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:19:59.982508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] PATH_INFO: `/v3/projects/bec9016d905e4d29b8e7c3f63c8a8810` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:19:59.983819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec9016d905e4d29b8e7c3f63c8a8810)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:19:59.985740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:00.038771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec9016d905e4d29b8e7c3f63c8a8810', 'request_id': 'req-081228cd-bfaa-421c-87c4-5739017e8e98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:00.044892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec9016d905e4d29b8e7c3f63c8a8810', 'request_id': 'req-081228cd-bfaa-421c-87c4-5739017e8e98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:00.052328 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec9016d905e4d29b8e7c3f63c8a8810', 'request_id': 'req-081228cd-bfaa-421c-87c4-5739017e8e98'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:00.069344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] The token cache is being invalidate because project bec9016d905e4d29b8e7c3f63c8a8810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:20:00.070152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:00.070805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-081228cd-bfaa-421c-87c4-5739017e8e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:00.072394 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1303/2597] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:19:59 2022] DELETE /identity/v3/projects/bec9016d905e4d29b8e7c3f63c8a8810 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:20:00.077625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8810d84-3918-4e8f-af40-91d67a92418f None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.078049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8810d84-3918-4e8f-af40-91d67a92418f None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.078409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8810d84-3918-4e8f-af40-91d67a92418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.098226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d8810d84-3918-4e8f-af40-91d67a92418f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:20:00.099456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d8810d84-3918-4e8f-af40-91d67a92418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:00.169092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1295/2598] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:20:00.177523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584f40-1925-44ab-bbbf-a13f08001e54 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.177835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584f40-1925-44ab-bbbf-a13f08001e54 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.178147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584f40-1925-44ab-bbbf-a13f08001e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.200914 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1a584f40-1925-44ab-bbbf-a13f08001e54 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:20:00.202274 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1a584f40-1925-44ab-bbbf-a13f08001e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:00.211923 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1304/2599] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:20:00.216854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8810d84-3918-4e8f-af40-91d67a92418f None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:00.235071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8810d84-3918-4e8f-af40-91d67a92418f None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:00.240923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:00.241590 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.241883 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.242156 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.242887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:20:00.243188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:00.244798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:00.268851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1296/2600] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:20:00.273922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a584f40-1925-44ab-bbbf-a13f08001e54 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:00.283935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a584f40-1925-44ab-bbbf-a13f08001e54 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:00.298140 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bfa96-8274-4e45-92bd-1dea29a4844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:00.298730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bfa96-8274-4e45-92bd-1dea29a4844e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.299005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bfa96-8274-4e45-92bd-1dea29a4844e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.299277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bfa96-8274-4e45-92bd-1dea29a4844e admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.300062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bfa96-8274-4e45-92bd-1dea29a4844e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:00.302428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bfa96-8274-4e45-92bd-1dea29a4844e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:00.327137 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:00.351368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1305/2601] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:20:00 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:20:00.355579 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:00.366056 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740347-b08b-4cf6-b086-9fb3b4c0cdd0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:00.425845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1362-41fc-457a-a6d4-5e52b960a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:00.426536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1362-41fc-457a-a6d4-5e52b960a08b admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.426808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1362-41fc-457a-a6d4-5e52b960a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.427077 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1362-41fc-457a-a6d4-5e52b960a08b admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.427752 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1362-41fc-457a-a6d4-5e52b960a08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:00.430037 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1362-41fc-457a-a6d4-5e52b960a08b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:00.436661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:00.454223 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1297/2602] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:20:00 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:20:00.458805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bfa96-8274-4e45-92bd-1dea29a4844e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:00.468972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bfa96-8274-4e45-92bd-1dea29a4844e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:00.473914 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ab08a-9984-4edd-8fca-602f92456e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:00.474558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab08a-9984-4edd-8fca-602f92456e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.474835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab08a-9984-4edd-8fca-602f92456e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.475143 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab08a-9984-4edd-8fca-602f92456e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.475859 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab08a-9984-4edd-8fca-602f92456e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:00.477446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab08a-9984-4edd-8fca-602f92456e8b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:00.487454 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1306/2603] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:20:00.491536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1362-41fc-457a-a6d4-5e52b960a08b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:00.502213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1362-41fc-457a-a6d4-5e52b960a08b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:00.507954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c054c4-7ad5-4f2e-ba3c-03a8a769a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:00.508642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c054c4-7ad5-4f2e-ba3c-03a8a769a463 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.508921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c054c4-7ad5-4f2e-ba3c-03a8a769a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.509225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c054c4-7ad5-4f2e-ba3c-03a8a769a463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.509996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c054c4-7ad5-4f2e-ba3c-03a8a769a463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:00.511594 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c054c4-7ad5-4f2e-ba3c-03a8a769a463 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:00.522891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1298/2604] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:20:00.527632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ab08a-9984-4edd-8fca-602f92456e8b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:00.543580 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ab08a-9984-4edd-8fca-602f92456e8b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:00.552524 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:00.553760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.554442 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.554712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] PATH_INFO: `/v3/projects/e2d73f7bfc184cacb49809a89563b585/users/4b43fe7da444445fbffb6158d332d99d/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.582478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d73f7bfc184cacb49809a89563b585, user_id=4b43fe7da444445fbffb6158d332d99d, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:00.585152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:00.603538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1307/2605] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:20:00 2022] PUT /identity/v3/projects/e2d73f7bfc184cacb49809a89563b585/users/4b43fe7da444445fbffb6158d332d99d/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:20:00.609042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9977-ec98-4b65-ac5d-c268b799acf0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.609623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9977-ec98-4b65-ac5d-c268b799acf0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.609623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9977-ec98-4b65-ac5d-c268b799acf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.631710 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1d9f9977-ec98-4b65-ac5d-c268b799acf0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:20:00.632990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1d9f9977-ec98-4b65-ac5d-c268b799acf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:00.699282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1299/2606] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:20:00.710785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:00.712878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:00.773614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc7da8-bfa0-491c-8c42-d13f4911614b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:00.777955 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:00.778601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:00.778881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:00.779148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:00.789180 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:00.790626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:00.800341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1308/2607] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:20:04.703862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24924e-7977-4cc8-b144-acf77deb2183 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:04.704377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24924e-7977-4cc8-b144-acf77deb2183 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:04.704377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24924e-7977-4cc8-b144-acf77deb2183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:04.732737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-6f24924e-7977-4cc8-b144-acf77deb2183 None None] MFA Rules not processed for user `4b43fe7da444445fbffb6158d332d99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:20:04.733996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6f24924e-7977-4cc8-b144-acf77deb2183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:04.811353 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1300/2608] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:20:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:20:04.827286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:04.828994 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:04.907002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b841-11d8-4a7a-8070-ff863e991435 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:04.912939 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:04.913654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:04.913935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:04.914211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:04.922823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:04.924382 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:04.935253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1309/2609] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:20:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:20:06.321923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0b72-3ad7-49f8-b978-4d3d272fb68c None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:06.322451 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0b72-3ad7-49f8-b978-4d3d272fb68c None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:06.322569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0b72-3ad7-49f8-b978-4d3d272fb68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:06.342131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-447d0b72-3ad7-49f8-b978-4d3d272fb68c None None] MFA Rules not processed for user `4b43fe7da444445fbffb6158d332d99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:20:06.343380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-447d0b72-3ad7-49f8-b978-4d3d272fb68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:06.350767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1301/2610] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:20:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:20:14.931214 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:16.336897 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:27.841178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:27.842678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:27.925185 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4429-7c73-44e4-8840-c42da761227f service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:27.930592 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:27.931308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:27.931805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:27.931805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:27.933594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:27.945333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:27.947650 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:27.957843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1310/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:20:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:20:31.800524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eb0fb-c3b7-460d-95d5-1085c998d336 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:31.801030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eb0fb-c3b7-460d-95d5-1085c998d336 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:31.801142 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eb0fb-c3b7-460d-95d5-1085c998d336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:31.820997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-887eb0fb-c3b7-460d-95d5-1085c998d336 None None] MFA Rules not processed for user `fc6a4d6c1f834720a69ee30d5ae63cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:20:31.822550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-887eb0fb-c3b7-460d-95d5-1085c998d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:31.879631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1302/2612] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:20:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:20:37.953772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=32 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:41.872576 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=25 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:45.175150 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:45.176772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:45.189732 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e57d05-05a7-4447-b665-3ef6f29107fb service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:45.193821 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:45.194486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:45.194763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:45.195033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:45.196984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:45.261307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:45.265211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:45.273785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1311/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:20:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:20:50.672856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eb0fb-c3b7-460d-95d5-1085c998d336 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:50.683248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eb0fb-c3b7-460d-95d5-1085c998d336 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:50.688565 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:50.689267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:50.689546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:50.690426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:50.692476 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:50.706074 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:50.707538 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:50.717563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1303/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:20:55.269516 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=28 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:57.255014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:57.256514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:57.271615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954904a-e4b0-4cc6-978c-fe5feebcd241 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:57.276091 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:57.276975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:57.277258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:57.277530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] PATH_INFO: `/v3/users/9a1e3a5739ac4a46beb0baa8887660f5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:57.278791 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1e3a5739ac4a46beb0baa8887660f5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:57.280714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:57.331623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1e3a5739ac4a46beb0baa8887660f5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.332303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1e3a5739ac4a46beb0baa8887660f5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.343642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1e3a5739ac4a46beb0baa8887660f5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.351341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1e3a5739ac4a46beb0baa8887660f5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.363471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1e3a5739ac4a46beb0baa8887660f5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.369487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1312/2615] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:20:57 2022] DELETE /identity/v3/users/9a1e3a5739ac4a46beb0baa8887660f5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:20:57.552842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:57.565621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da787f-9273-4406-b1c5-b4b5bf759c1f service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:57.635054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:57.635924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:57.636348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:57.636499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] PATH_INFO: `/v3/projects/e456e86229d84ae28c56cf25357f99bc` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:57.637743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e456e86229d84ae28c56cf25357f99bc)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:57.639728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:57.695828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e456e86229d84ae28c56cf25357f99bc', 'request_id': 'req-238b46a9-ad5a-440a-8801-f6d175d8fe2d'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.702298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e456e86229d84ae28c56cf25357f99bc', 'request_id': 'req-238b46a9-ad5a-440a-8801-f6d175d8fe2d'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.708726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e456e86229d84ae28c56cf25357f99bc', 'request_id': 'req-238b46a9-ad5a-440a-8801-f6d175d8fe2d'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.722802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] The token cache is being invalidate because project e456e86229d84ae28c56cf25357f99bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:20:57.723092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.723720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.725312 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1304/2616] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:20:57 2022] DELETE /identity/v3/projects/e456e86229d84ae28c56cf25357f99bc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:20:57.729439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:57.730933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:57.744128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92ed27-b3eb-406b-b11e-12f593c5500f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:57.806164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:57.807021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:57.807300 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:57.807572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] PATH_INFO: `/v3/users/639ee8a0c5224dfcba5ff5bef4d1c085` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:57.808842 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=639ee8a0c5224dfcba5ff5bef4d1c085)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:57.810846 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:57.865660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639ee8a0c5224dfcba5ff5bef4d1c085'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.866471 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639ee8a0c5224dfcba5ff5bef4d1c085'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.876641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639ee8a0c5224dfcba5ff5bef4d1c085'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.884409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639ee8a0c5224dfcba5ff5bef4d1c085'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.894912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:57.900740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639ee8a0c5224dfcba5ff5bef4d1c085'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:57.909874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1313/2617] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:20:57 2022] DELETE /identity/v3/users/639ee8a0c5224dfcba5ff5bef4d1c085 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:20:58.081946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:20:58.083433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:20:58.097241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b46a9-ad5a-440a-8801-f6d175d8fe2d admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:20:58.156865 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:20:58.157745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:20:58.158059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:20:58.158331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] PATH_INFO: `/v3/projects/3dbf727359934d70ac5bfb0a647205a0` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:20:58.159543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbf727359934d70ac5bfb0a647205a0)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:20:58.161468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:20:58.183138 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:20:58.216099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbf727359934d70ac5bfb0a647205a0', 'request_id': 'req-c35a8882-be01-4c69-b441-84ebdfb94bb4'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:58.224817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbf727359934d70ac5bfb0a647205a0', 'request_id': 'req-c35a8882-be01-4c69-b441-84ebdfb94bb4'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:58.234401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbf727359934d70ac5bfb0a647205a0', 'request_id': 'req-c35a8882-be01-4c69-b441-84ebdfb94bb4'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:58.252253 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] The token cache is being invalidate because project 3dbf727359934d70ac5bfb0a647205a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:20:58.252549 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:58.253179 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-c35a8882-be01-4c69-b441-84ebdfb94bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:20:58.254859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1305/2618] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:20:58 2022] DELETE /identity/v3/projects/3dbf727359934d70ac5bfb0a647205a0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:21:07.908352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:08.248508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:34.072072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:21:34.073750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:21:34.133509 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e23656-1138-49ff-9548-dbe768e88bea admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:21:34.194507 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaeaea-dabe-4cba-8afd-abc3d9f6a422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:21:34.195472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaeaea-dabe-4cba-8afd-abc3d9f6a422 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:21:34.195757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaeaea-dabe-4cba-8afd-abc3d9f6a422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:21:34.196030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaeaea-dabe-4cba-8afd-abc3d9f6a422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:21:34.199655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5dcaeaea-dabe-4cba-8afd-abc3d9f6a422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:21:34.289127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaeaea-dabe-4cba-8afd-abc3d9f6a422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:21:34.290663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaeaea-dabe-4cba-8afd-abc3d9f6a422 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:21:34.300849 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1314/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:21:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:21:44.295873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=68 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:44.328389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5c45e-a498-4a47-b616-4058eeed5c03 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:21:44.328924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5c45e-a498-4a47-b616-4058eeed5c03 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:21:44.328924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5c45e-a498-4a47-b616-4058eeed5c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:21:44.348797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a7c5c45e-a498-4a47-b616-4058eeed5c03 None None] MFA Rules not processed for user `d21524f4232648ebaed76e1d7d5daf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:21:44.350715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a7c5c45e-a498-4a47-b616-4058eeed5c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:21:44.362755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1306/2620] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:21:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:21:54.342862 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:21:59.820702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfe0a-0cb3-43ca-a0cb-a4c99700d5b4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:21:59.821254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfe0a-0cb3-43ca-a0cb-a4c99700d5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:21:59.821254 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbfe0a-0cb3-43ca-a0cb-a4c99700d5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:21:59.839823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-08fbfe0a-0cb3-43ca-a0cb-a4c99700d5b4 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:21:59.841039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-08fbfe0a-0cb3-43ca-a0cb-a4c99700d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:21:59.900377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1315/2621] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:21:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:21:59.951071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5c45e-a498-4a47-b616-4058eeed5c03 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:21:59.952742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a7c5c45e-a498-4a47-b616-4058eeed5c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:00.033619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5c45e-a498-4a47-b616-4058eeed5c03 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:00.040585 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69569be2-1081-42db-93cf-b9cb80320c73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:00.041679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569be2-1081-42db-93cf-b9cb80320c73 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:00.042206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569be2-1081-42db-93cf-b9cb80320c73 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:00.042575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569be2-1081-42db-93cf-b9cb80320c73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:00.053090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69569be2-1081-42db-93cf-b9cb80320c73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:00.055196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69569be2-1081-42db-93cf-b9cb80320c73 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:00.064899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1307/2622] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:03.279819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbfe0a-0cb3-43ca-a0cb-a4c99700d5b4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:03.281340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-08fbfe0a-0cb3-43ca-a0cb-a4c99700d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:03.352968 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbfe0a-0cb3-43ca-a0cb-a4c99700d5b4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:03.356942 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f879ed8-ccce-4c71-862c-b9f55c430b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:03.357835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879ed8-ccce-4c71-862c-b9f55c430b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:03.358119 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879ed8-ccce-4c71-862c-b9f55c430b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:03.358540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879ed8-ccce-4c71-862c-b9f55c430b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:03.360381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3f879ed8-ccce-4c71-862c-b9f55c430b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:03.432528 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f879ed8-ccce-4c71-862c-b9f55c430b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:03.434339 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f879ed8-ccce-4c71-862c-b9f55c430b11 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:03.449621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1316/2623] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:22:10.062006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=32 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:13.441332 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=75 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:14.006825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d582d93-df73-4a8b-b0a5-6a2417ff2e0e None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.007421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d582d93-df73-4a8b-b0a5-6a2417ff2e0e None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.007421 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d582d93-df73-4a8b-b0a5-6a2417ff2e0e None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.008930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1308/2624] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 17:22:14.014664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af88c-98a1-4099-993a-300c63359fe1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.014952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af88c-98a1-4099-993a-300c63359fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.015222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af88c-98a1-4099-993a-300c63359fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.033909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2b2af88c-98a1-4099-993a-300c63359fe1 None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:14.035125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2b2af88c-98a1-4099-993a-300c63359fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:14.111473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1317/2625] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:22:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:14.125155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d582d93-df73-4a8b-b0a5-6a2417ff2e0e None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:14.127091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2d582d93-df73-4a8b-b0a5-6a2417ff2e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:14.189334 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d582d93-df73-4a8b-b0a5-6a2417ff2e0e None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:14.193020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c23ffa-a827-4a24-bc7f-7ffb87ab91c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c211cd37d7f49eaa916d332580135c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:14.193679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23ffa-a827-4a24-bc7f-7ffb87ab91c8 service glance] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.193997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23ffa-a827-4a24-bc7f-7ffb87ab91c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.194274 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c23ffa-a827-4a24-bc7f-7ffb87ab91c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.205738 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23ffa-a827-4a24-bc7f-7ffb87ab91c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:14.207408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c23ffa-a827-4a24-bc7f-7ffb87ab91c8 service glance] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:14.220049 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1309/2626] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:22:14.293663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841beeb-5e58-4dbb-98af-7de6def6c088 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.293986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841beeb-5e58-4dbb-98af-7de6def6c088 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.294268 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841beeb-5e58-4dbb-98af-7de6def6c088 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.295673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1318/2627] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:22:14.300604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339be3e8-2b09-4e74-8df9-8fb0f8de8ead None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.300896 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339be3e8-2b09-4e74-8df9-8fb0f8de8ead None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.301175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339be3e8-2b09-4e74-8df9-8fb0f8de8ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.338859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-339be3e8-2b09-4e74-8df9-8fb0f8de8ead None None] MFA Rules not processed for user `2a92136d53514159a22faacb60ef0c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:14.340366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-339be3e8-2b09-4e74-8df9-8fb0f8de8ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:14.347821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1310/2628] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:22:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:14.361715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841beeb-5e58-4dbb-98af-7de6def6c088 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:14.378437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841beeb-5e58-4dbb-98af-7de6def6c088 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:14.382677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef744-528a-4593-bb39-b5faf83d9d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:14.383334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef744-528a-4593-bb39-b5faf83d9d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.383611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef744-528a-4593-bb39-b5faf83d9d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.383884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef744-528a-4593-bb39-b5faf83d9d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.391189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ef744-528a-4593-bb39-b5faf83d9d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:14.392618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ef744-528a-4593-bb39-b5faf83d9d2c service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:14.400958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1319/2629] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:22:14.487954 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991f84-bde3-44e7-a707-463afa7a1740 None None] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.488381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991f84-bde3-44e7-a707-463afa7a1740 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.488784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991f84-bde3-44e7-a707-463afa7a1740 None None] PATH_INFO: `/` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.491075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1311/2630] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jun 23 17:22:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 17:22:14.497606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762f4bd-b49c-437f-bf8d-662c99a84d2b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.498136 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762f4bd-b49c-437f-bf8d-662c99a84d2b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.498238 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762f4bd-b49c-437f-bf8d-662c99a84d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.518211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2762f4bd-b49c-437f-bf8d-662c99a84d2b None None] MFA Rules not processed for user `10b3274005534830b0768b122769dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:14.519447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2762f4bd-b49c-437f-bf8d-662c99a84d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:14.530172 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1320/2631] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jun 23 17:22:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:14.540810 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991f84-bde3-44e7-a707-463afa7a1740 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:14.553825 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991f84-bde3-44e7-a707-463afa7a1740 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:14.558676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60304cf-6760-4ce3-b641-62aa6ed66e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:14.559341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60304cf-6760-4ce3-b641-62aa6ed66e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:14.559616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60304cf-6760-4ce3-b641-62aa6ed66e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:14.559876 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60304cf-6760-4ce3-b641-62aa6ed66e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:14.571884 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60304cf-6760-4ce3-b641-62aa6ed66e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:14.573328 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60304cf-6760-4ce3-b641-62aa6ed66e18 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:14.584636 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1312/2632] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:22:24.512358 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=40 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:24.579539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=41 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:24.611368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060fd8c-b358-48fe-8522-9b586b5df588 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:24.611654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060fd8c-b358-48fe-8522-9b586b5df588 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:24.611929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060fd8c-b358-48fe-8522-9b586b5df588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:24.632363 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b060fd8c-b358-48fe-8522-9b586b5df588 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:24.633641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b060fd8c-b358-48fe-8522-9b586b5df588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:24.642305 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1321/2633] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:22:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:24.654569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60304cf-6760-4ce3-b641-62aa6ed66e18 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:24.667024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60304cf-6760-4ce3-b641-62aa6ed66e18 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:24.672915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:24.673568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:24.673878 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:24.674153 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:24.684461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:24.686541 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:24.697457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1313/2634] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:34.626742 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:34.691887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=6 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:46.521718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060fd8c-b358-48fe-8522-9b586b5df588 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:46.531980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060fd8c-b358-48fe-8522-9b586b5df588 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:46.536566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:46.537178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:46.537451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:46.537728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:46.539900 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:46.609414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:46.610971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:46.621863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1322/2635] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:22:49.951461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:49.953693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:49.970943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd058-951f-40d2-b7f8-8364548e0490 service swift] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:49.975467 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:49.976346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:49.976626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:49.976927 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] PATH_INFO: `/v3/users/fc6a4d6c1f834720a69ee30d5ae63cc9` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:49.991101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6a4d6c1f834720a69ee30d5ae63cc9)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:49.993046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:50.044737 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6a4d6c1f834720a69ee30d5ae63cc9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.054686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6a4d6c1f834720a69ee30d5ae63cc9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.066893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6a4d6c1f834720a69ee30d5ae63cc9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.073697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6a4d6c1f834720a69ee30d5ae63cc9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.074396 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-9c86a495-fa91-48d4-8b6f-173b477894ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6a4d6c1f834720a69ee30d5ae63cc9'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.080314 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1314/2636] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:22:49 2022] DELETE /identity/v3/users/fc6a4d6c1f834720a69ee30d5ae63cc9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:22:50.258132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:50.270433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6aaa-d252-4c93-b87d-b082a6cce1c3 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:50.329492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:50.330389 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.330659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.330922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] PATH_INFO: `/v3/projects/201cf53eaff642e78cf394182b0b9972` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.342002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=201cf53eaff642e78cf394182b0b9972)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:50.343926 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:50.393329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201cf53eaff642e78cf394182b0b9972', 'request_id': 'req-53165f14-d83e-4b33-8f5b-88c86d98e693'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.399417 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201cf53eaff642e78cf394182b0b9972', 'request_id': 'req-53165f14-d83e-4b33-8f5b-88c86d98e693'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.406251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201cf53eaff642e78cf394182b0b9972', 'request_id': 'req-53165f14-d83e-4b33-8f5b-88c86d98e693'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.420425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] The token cache is being invalidate because project 201cf53eaff642e78cf394182b0b9972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:22:50.420787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.421341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-53165f14-d83e-4b33-8f5b-88c86d98e693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:50.423101 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1323/2637] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:22:50 2022] DELETE /identity/v3/projects/201cf53eaff642e78cf394182b0b9972 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:22:50.428758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867e440-0a19-4aca-93cf-68191c17c268 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.429059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867e440-0a19-4aca-93cf-68191c17c268 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.429337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867e440-0a19-4aca-93cf-68191c17c268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.448766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d867e440-0a19-4aca-93cf-68191c17c268 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:50.450121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d867e440-0a19-4aca-93cf-68191c17c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:50.514325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1315/2638] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:50.522729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5106cd-f37b-4c85-ae1a-744410c545d5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.523028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5106cd-f37b-4c85-ae1a-744410c545d5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.523340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5106cd-f37b-4c85-ae1a-744410c545d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.540974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bc5106cd-f37b-4c85-ae1a-744410c545d5 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:50.542239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bc5106cd-f37b-4c85-ae1a-744410c545d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:50.551074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1324/2639] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:22:50.555766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867e440-0a19-4aca-93cf-68191c17c268 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:50.566291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867e440-0a19-4aca-93cf-68191c17c268 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:50.571543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:50.572204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.572489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.572768 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.573513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:22:50.573849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:50.575461 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:50.587905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1316/2640] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:22:50.592139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5106cd-f37b-4c85-ae1a-744410c545d5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:50.602099 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5106cd-f37b-4c85-ae1a-744410c545d5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:50.607286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93cb79-5e39-4627-8234-4a6daa076f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:50.607936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93cb79-5e39-4627-8234-4a6daa076f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.608225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93cb79-5e39-4627-8234-4a6daa076f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.608495 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93cb79-5e39-4627-8234-4a6daa076f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.609202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93cb79-5e39-4627-8234-4a6daa076f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:50.611193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93cb79-5e39-4627-8234-4a6daa076f49 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:50.615497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:50.640639 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1325/2641] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:22:50 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:22:50.645020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:50.655957 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b6df4-81c6-4776-80fc-a4f335b3a707 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:50.704654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:50.719270 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02953ef-49e3-403b-8184-c93a2b1ca996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:50.719983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02953ef-49e3-403b-8184-c93a2b1ca996 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.720581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02953ef-49e3-403b-8184-c93a2b1ca996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.720921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02953ef-49e3-403b-8184-c93a2b1ca996 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.721885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02953ef-49e3-403b-8184-c93a2b1ca996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:50.723829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02953ef-49e3-403b-8184-c93a2b1ca996 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:50.745666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1317/2642] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:22:50 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:22:50.749858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93cb79-5e39-4627-8234-4a6daa076f49 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:50.761133 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93cb79-5e39-4627-8234-4a6daa076f49 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:50.766449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a2c10-d40d-411e-84b6-b123b23ad378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:50.767218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2c10-d40d-411e-84b6-b123b23ad378 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.767494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2c10-d40d-411e-84b6-b123b23ad378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.767761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2c10-d40d-411e-84b6-b123b23ad378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.768491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a2c10-d40d-411e-84b6-b123b23ad378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:50.770120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a2c10-d40d-411e-84b6-b123b23ad378 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:50.780530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1326/2643] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:22:50.784773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02953ef-49e3-403b-8184-c93a2b1ca996 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:50.795231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02953ef-49e3-403b-8184-c93a2b1ca996 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:50.800268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db6c08-a077-47ff-b2d2-2823dbc2d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:50.800923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6c08-a077-47ff-b2d2-2823dbc2d6da admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.801201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6c08-a077-47ff-b2d2-2823dbc2d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.801471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6c08-a077-47ff-b2d2-2823dbc2d6da admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.802229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db6c08-a077-47ff-b2d2-2823dbc2d6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:50.804231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db6c08-a077-47ff-b2d2-2823dbc2d6da admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:50.814859 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1318/2644] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:22:50.822546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a2c10-d40d-411e-84b6-b123b23ad378 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:50.833265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a2c10-d40d-411e-84b6-b123b23ad378 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:50.838659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:50.839545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.839833 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.840107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] PATH_INFO: `/v3/projects/1296c86ec7434578b08c6acbb7c3c357/users/353832e827a24bccae721bc95f50fa1f/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.858898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1296c86ec7434578b08c6acbb7c3c357, user_id=353832e827a24bccae721bc95f50fa1f, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:50.861865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:50.881439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1327/2645] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:22:50 2022] PUT /identity/v3/projects/1296c86ec7434578b08c6acbb7c3c357/users/353832e827a24bccae721bc95f50fa1f/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:22:50.891715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137798-e663-4f0e-bffc-742844e958bc None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:50.892130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137798-e663-4f0e-bffc-742844e958bc None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:50.892545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4137798-e663-4f0e-bffc-742844e958bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:50.921321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e4137798-e663-4f0e-bffc-742844e958bc None None] MFA Rules not processed for user `353832e827a24bccae721bc95f50fa1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:50.922569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e4137798-e663-4f0e-bffc-742844e958bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:51.005282 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1319/2646] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:22:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:51.012640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:51.014720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:51.091264 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd644577-6c8e-4cc2-8c75-b787df7f29d1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:51.096951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350c14a-eadf-4395-8ccd-551a66719ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:51.097606 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c14a-eadf-4395-8ccd-551a66719ec3 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:51.097915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c14a-eadf-4395-8ccd-551a66719ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:51.098197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c14a-eadf-4395-8ccd-551a66719ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:51.106626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350c14a-eadf-4395-8ccd-551a66719ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:51.108215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350c14a-eadf-4395-8ccd-551a66719ec3 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:51.122289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1328/2647] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:22:51.344348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4137798-e663-4f0e-bffc-742844e958bc None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:51.409199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4137798-e663-4f0e-bffc-742844e958bc None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:51.414646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:51.415511 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:51.415788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:51.416053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] PATH_INFO: `/v3/users/353832e827a24bccae721bc95f50fa1f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:51.417277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=353832e827a24bccae721bc95f50fa1f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:51.419254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:51.488906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353832e827a24bccae721bc95f50fa1f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:51.501524 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353832e827a24bccae721bc95f50fa1f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:51.506512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:51.516128 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353832e827a24bccae721bc95f50fa1f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:51.523308 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353832e827a24bccae721bc95f50fa1f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:51.523976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353832e827a24bccae721bc95f50fa1f'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:51.530032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1320/2648] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:22:51 2022] DELETE /identity/v3/users/353832e827a24bccae721bc95f50fa1f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:22:51.534888 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eafc3-1fb8-4aaa-99cd-195bafd8abe8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:51.535415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eafc3-1fb8-4aaa-99cd-195bafd8abe8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:51.535415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eafc3-1fb8-4aaa-99cd-195bafd8abe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:51.554975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e71eafc3-1fb8-4aaa-99cd-195bafd8abe8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:51.556301 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e71eafc3-1fb8-4aaa-99cd-195bafd8abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:51.616211 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1329/2649] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:51.627026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:51.628542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:51.691547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0737fda-edd6-4952-b1ba-d3ae3c88b6e8 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:51.695628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c270208-e2fb-4b04-a139-6550c8f58018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:51.696290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c270208-e2fb-4b04-a139-6550c8f58018 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:51.696572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c270208-e2fb-4b04-a139-6550c8f58018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:51.696849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c270208-e2fb-4b04-a139-6550c8f58018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:51.707917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c270208-e2fb-4b04-a139-6550c8f58018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:51.709372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c270208-e2fb-4b04-a139-6550c8f58018 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:51.719357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1321/2650] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:22:52.023042 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eafc3-1fb8-4aaa-99cd-195bafd8abe8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.024546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e71eafc3-1fb8-4aaa-99cd-195bafd8abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:52.037083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eafc3-1fb8-4aaa-99cd-195bafd8abe8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.042556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.044722 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.045020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.045269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] PATH_INFO: `/v3/projects/1296c86ec7434578b08c6acbb7c3c357` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.046579 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1296c86ec7434578b08c6acbb7c3c357)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.050457 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.091197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:52.104671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1296c86ec7434578b08c6acbb7c3c357', 'request_id': 'req-6ad4f05b-df4d-4199-b97e-012750444715'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:52.110338 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1296c86ec7434578b08c6acbb7c3c357', 'request_id': 'req-6ad4f05b-df4d-4199-b97e-012750444715'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:52.123874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1296c86ec7434578b08c6acbb7c3c357', 'request_id': 'req-6ad4f05b-df4d-4199-b97e-012750444715'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:52.138879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] The token cache is being invalidate because project 1296c86ec7434578b08c6acbb7c3c357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:22:52.139144 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:52.139764 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ad4f05b-df4d-4199-b97e-012750444715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:22:52.141424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1330/2651] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:22:52 2022] DELETE /identity/v3/projects/1296c86ec7434578b08c6acbb7c3c357 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:22:52.146819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a02c5-5969-4699-aace-5702d8a8d8c0 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.150001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a02c5-5969-4699-aace-5702d8a8d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.150001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a02c5-5969-4699-aace-5702d8a8d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.168675 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-598a02c5-5969-4699-aace-5702d8a8d8c0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:52.170244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-598a02c5-5969-4699-aace-5702d8a8d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:52.238368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1322/2652] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:52.247412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0bb5c-2791-4176-906d-4dfc4c0a3b41 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.247832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0bb5c-2791-4176-906d-4dfc4c0a3b41 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.248191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0bb5c-2791-4176-906d-4dfc4c0a3b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.267133 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8aa0bb5c-2791-4176-906d-4dfc4c0a3b41 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:52.268357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8aa0bb5c-2791-4176-906d-4dfc4c0a3b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:52.276577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1331/2653] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:52.280923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a02c5-5969-4699-aace-5702d8a8d8c0 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.291054 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a02c5-5969-4699-aace-5702d8a8d8c0 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.295963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.296632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.296914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.297192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.297987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:22:52.298410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.299913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.312647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1323/2654] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:22:52.317207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0bb5c-2791-4176-906d-4dfc4c0a3b41 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.326720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0bb5c-2791-4176-906d-4dfc4c0a3b41 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.332178 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87b0d-42de-45e3-9cb5-00b12f42e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.332845 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87b0d-42de-45e3-9cb5-00b12f42e31a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.333166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87b0d-42de-45e3-9cb5-00b12f42e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.333428 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87b0d-42de-45e3-9cb5-00b12f42e31a admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.334148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b87b0d-42de-45e3-9cb5-00b12f42e31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.336053 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b87b0d-42de-45e3-9cb5-00b12f42e31a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.365112 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1332/2655] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:22:52 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:22:52.369244 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.379440 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82eb52-5745-4345-ac08-1e7a51bbb094 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.437032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15802335-dce7-4d71-a51a-5938fd9836be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.437714 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802335-dce7-4d71-a51a-5938fd9836be admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.438025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802335-dce7-4d71-a51a-5938fd9836be admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.438466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802335-dce7-4d71-a51a-5938fd9836be admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.439327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15802335-dce7-4d71-a51a-5938fd9836be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.444646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15802335-dce7-4d71-a51a-5938fd9836be admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.455351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:52.471227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1324/2656] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:22:52 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:22:52.475031 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87b0d-42de-45e3-9cb5-00b12f42e31a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.486314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87b0d-42de-45e3-9cb5-00b12f42e31a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.491387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e85f-9e47-4935-853c-f2f09534a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.492060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e85f-9e47-4935-853c-f2f09534a644 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.492336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e85f-9e47-4935-853c-f2f09534a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.492633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e85f-9e47-4935-853c-f2f09534a644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.493373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260e85f-9e47-4935-853c-f2f09534a644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.495016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260e85f-9e47-4935-853c-f2f09534a644 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.505910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1333/2657] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:22:52.511366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15802335-dce7-4d71-a51a-5938fd9836be admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.521808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15802335-dce7-4d71-a51a-5938fd9836be admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.527075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460feb4-b374-48a5-9dda-81263f499209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.527744 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460feb4-b374-48a5-9dda-81263f499209 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.528026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460feb4-b374-48a5-9dda-81263f499209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.528297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460feb4-b374-48a5-9dda-81263f499209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.529022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460feb4-b374-48a5-9dda-81263f499209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.530666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460feb4-b374-48a5-9dda-81263f499209 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.541470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1325/2658] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:22:52.545587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e85f-9e47-4935-853c-f2f09534a644 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.557022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e85f-9e47-4935-853c-f2f09534a644 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.562805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fab47b-63ed-4069-8508-7197d97ee691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.563698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab47b-63ed-4069-8508-7197d97ee691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.563977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab47b-63ed-4069-8508-7197d97ee691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.564253 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab47b-63ed-4069-8508-7197d97ee691 admin admin] PATH_INFO: `/v3/projects/a4a1ede56045408594b1e923d145f7ad/users/05141585390243e79aaae002fcfc3906/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.580525 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fab47b-63ed-4069-8508-7197d97ee691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a1ede56045408594b1e923d145f7ad, user_id=05141585390243e79aaae002fcfc3906, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.583272 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fab47b-63ed-4069-8508-7197d97ee691 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.606504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1334/2659] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:22:52 2022] PUT /identity/v3/projects/a4a1ede56045408594b1e923d145f7ad/users/05141585390243e79aaae002fcfc3906/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:22:52.617140 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0f935-07d3-41c2-a292-6af2a9da566a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.617435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0f935-07d3-41c2-a292-6af2a9da566a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.617711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0f935-07d3-41c2-a292-6af2a9da566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.626751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571831d7-0da5-40f4-ba10-7f565eda6fa1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.627022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571831d7-0da5-40f4-ba10-7f565eda6fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.627342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571831d7-0da5-40f4-ba10-7f565eda6fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.644608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-571831d7-0da5-40f4-ba10-7f565eda6fa1 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:52.645886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-571831d7-0da5-40f4-ba10-7f565eda6fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:52.649759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e4b0f935-07d3-41c2-a292-6af2a9da566a None None] MFA Rules not processed for user `05141585390243e79aaae002fcfc3906`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:52.651309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e4b0f935-07d3-41c2-a292-6af2a9da566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:52.704631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1335/2660] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 23 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:52.717086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571831d7-0da5-40f4-ba10-7f565eda6fa1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.718618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-571831d7-0da5-40f4-ba10-7f565eda6fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:52.730309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1326/2661] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:52.734800 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0f935-07d3-41c2-a292-6af2a9da566a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.792156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:52.796979 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571831d7-0da5-40f4-ba10-7f565eda6fa1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.804073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863a1b6-25bf-4533-aa34-dce4b218ddd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.804919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863a1b6-25bf-4533-aa34-dce4b218ddd9 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.805330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863a1b6-25bf-4533-aa34-dce4b218ddd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.805978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863a1b6-25bf-4533-aa34-dce4b218ddd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.812102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0f935-07d3-41c2-a292-6af2a9da566a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.814475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863a1b6-25bf-4533-aa34-dce4b218ddd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.816777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863a1b6-25bf-4533-aa34-dce4b218ddd9 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.817380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf041-a567-4385-ad39-917c52168586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.818080 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf041-a567-4385-ad39-917c52168586 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.818360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf041-a567-4385-ad39-917c52168586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.818631 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf041-a567-4385-ad39-917c52168586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.819325 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cf041-a567-4385-ad39-917c52168586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.821201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cf041-a567-4385-ad39-917c52168586 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.825482 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1336/2662] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:22:52.848547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1327/2663] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:22:52 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:22:52.852633 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863a1b6-25bf-4533-aa34-dce4b218ddd9 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.863839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863a1b6-25bf-4533-aa34-dce4b218ddd9 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.922918 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d445c-aa12-4942-98bf-8e57469a1e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.923598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d445c-aa12-4942-98bf-8e57469a1e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.923879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d445c-aa12-4942-98bf-8e57469a1e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.924235 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d445c-aa12-4942-98bf-8e57469a1e82 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.924876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d445c-aa12-4942-98bf-8e57469a1e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.926992 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d445c-aa12-4942-98bf-8e57469a1e82 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:52.960237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1337/2664] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:22:52 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:22:52.962533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf041-a567-4385-ad39-917c52168586 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:52.974868 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf041-a567-4385-ad39-917c52168586 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:52.980670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165915-7689-4254-8882-7ea6dd0d7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:52.981365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165915-7689-4254-8882-7ea6dd0d7154 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:52.981626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165915-7689-4254-8882-7ea6dd0d7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:52.981936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165915-7689-4254-8882-7ea6dd0d7154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:52.982682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b165915-7689-4254-8882-7ea6dd0d7154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:52.984302 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b165915-7689-4254-8882-7ea6dd0d7154 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:53.001438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1328/2665] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:22:53.003450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d445c-aa12-4942-98bf-8e57469a1e82 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:53.015138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d445c-aa12-4942-98bf-8e57469a1e82 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:53.020854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627058-105e-454d-9be3-50194379a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:53.021880 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627058-105e-454d-9be3-50194379a9af admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:53.022229 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627058-105e-454d-9be3-50194379a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:53.022546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627058-105e-454d-9be3-50194379a9af admin admin] PATH_INFO: `/v3/projects/94b9036aacc94be5ad62968cab9f9e12/users/7a36b16096414158b2a8b960754413a4/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:53.039224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627058-105e-454d-9be3-50194379a9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b9036aacc94be5ad62968cab9f9e12, user_id=7a36b16096414158b2a8b960754413a4, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:53.042083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627058-105e-454d-9be3-50194379a9af admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:53.057414 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1338/2666] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:22:53 2022] PUT /identity/v3/projects/94b9036aacc94be5ad62968cab9f9e12/users/7a36b16096414158b2a8b960754413a4/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:22:53.061841 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165915-7689-4254-8882-7ea6dd0d7154 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:53.073189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165915-7689-4254-8882-7ea6dd0d7154 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:53.121133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:22:53.136971 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5d33c-411f-4301-817a-98e4fd60270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:53.137655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5d33c-411f-4301-817a-98e4fd60270b admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:53.137988 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5d33c-411f-4301-817a-98e4fd60270b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:53.138263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5d33c-411f-4301-817a-98e4fd60270b admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:53.138996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5d33c-411f-4301-817a-98e4fd60270b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:53.140629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5d33c-411f-4301-817a-98e4fd60270b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:53.154106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1329/2667] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:22:53.156127 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627058-105e-454d-9be3-50194379a9af admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:53.167409 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627058-105e-454d-9be3-50194379a9af admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:53.172032 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:53.172932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:53.173216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:53.173496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] PATH_INFO: `/v3/projects/94b9036aacc94be5ad62968cab9f9e12/users/7a36b16096414158b2a8b960754413a4/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:53.176216 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b9036aacc94be5ad62968cab9f9e12, user_id=7a36b16096414158b2a8b960754413a4, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:53.179271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:53.189809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1339/2668] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:22:53 2022] PUT /identity/v3/projects/94b9036aacc94be5ad62968cab9f9e12/users/7a36b16096414158b2a8b960754413a4/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:22:53.200743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4265-7845-4d55-a33f-d0037d5228a8 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:53.201035 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4265-7845-4d55-a33f-d0037d5228a8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:53.201311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c4265-7845-4d55-a33f-d0037d5228a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:53.229720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c88c4265-7845-4d55-a33f-d0037d5228a8 None None] MFA Rules not processed for user `7a36b16096414158b2a8b960754413a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:22:53.230996 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c88c4265-7845-4d55-a33f-d0037d5228a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:53.301664 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1330/2669] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:22:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:22:53.315074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:53.317063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:22:53.388106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba229b14-a830-462d-8b14-c39c15d6b8a5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:53.392103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a822-1ad8-4a91-8c50-21c4fcd6d826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:53.392751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a822-1ad8-4a91-8c50-21c4fcd6d826 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:53.393142 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a822-1ad8-4a91-8c50-21c4fcd6d826 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:53.393463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a822-1ad8-4a91-8c50-21c4fcd6d826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:53.403715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14a822-1ad8-4a91-8c50-21c4fcd6d826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:53.405303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14a822-1ad8-4a91-8c50-21c4fcd6d826 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:53.416092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1340/2670] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:22:53.496899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c4265-7845-4d55-a33f-d0037d5228a8 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:22:53.506781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c4265-7845-4d55-a33f-d0037d5228a8 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:22:53.510761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3699c-bab7-4697-8fba-c65cb65c1fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:22:53.511406 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3699c-bab7-4697-8fba-c65cb65c1fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:22:53.511685 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3699c-bab7-4697-8fba-c65cb65c1fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:22:53.511963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3699c-bab7-4697-8fba-c65cb65c1fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:22:53.573643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3699c-bab7-4697-8fba-c65cb65c1fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:22:53.575068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3699c-bab7-4697-8fba-c65cb65c1fe8 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:22:53.584695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1331/2671] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:22:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:03.411788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:03.580100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=69 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:04.614218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a822-1ad8-4a91-8c50-21c4fcd6d826 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:04.687596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a822-1ad8-4a91-8c50-21c4fcd6d826 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:04.693005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:04.693898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:04.694175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:04.694445 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] PATH_INFO: `/v3/users/05141585390243e79aaae002fcfc3906` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:04.695658 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05141585390243e79aaae002fcfc3906)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:04.697605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:04.748072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05141585390243e79aaae002fcfc3906'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:04.748744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05141585390243e79aaae002fcfc3906'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:04.758356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05141585390243e79aaae002fcfc3906'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:04.765598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05141585390243e79aaae002fcfc3906'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:04.777999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05141585390243e79aaae002fcfc3906'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:04.783805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1341/2672] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:23:04 2022] DELETE /identity/v3/users/05141585390243e79aaae002fcfc3906 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:04.788533 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937f89-09d1-47c5-aaa9-d12aaa430e3a None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:04.789067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937f89-09d1-47c5-aaa9-d12aaa430e3a None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:04.789181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937f89-09d1-47c5-aaa9-d12aaa430e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:04.807819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-67937f89-09d1-47c5-aaa9-d12aaa430e3a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:04.809036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-67937f89-09d1-47c5-aaa9-d12aaa430e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:04.870656 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1332/2673] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:04.880575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:04.882079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:04.940080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01186a86-a7bf-4efb-b974-dd350bd5218b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:04.944397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068310-a00a-4de3-9f95-54e41d05ad0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:04.944975 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068310-a00a-4de3-9f95-54e41d05ad0f service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:04.945262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068310-a00a-4de3-9f95-54e41d05ad0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:04.945535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068310-a00a-4de3-9f95-54e41d05ad0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:04.959693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068310-a00a-4de3-9f95-54e41d05ad0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:04.961154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068310-a00a-4de3-9f95-54e41d05ad0f service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:04.971290 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1342/2674] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:05.256766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937f89-09d1-47c5-aaa9-d12aaa430e3a None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:05.258240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-67937f89-09d1-47c5-aaa9-d12aaa430e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:05.271026 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937f89-09d1-47c5-aaa9-d12aaa430e3a None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:05.276508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:05.277408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:05.277665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:05.277972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] PATH_INFO: `/v3/projects/a4a1ede56045408594b1e923d145f7ad` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:05.279254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a1ede56045408594b1e923d145f7ad)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:05.281201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:05.331938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a1ede56045408594b1e923d145f7ad', 'request_id': 'req-d803565c-c81c-48c5-8399-923b4aaa69a0'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.337518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a1ede56045408594b1e923d145f7ad', 'request_id': 'req-d803565c-c81c-48c5-8399-923b4aaa69a0'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.343698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a1ede56045408594b1e923d145f7ad', 'request_id': 'req-d803565c-c81c-48c5-8399-923b4aaa69a0'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.358510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] The token cache is being invalidate because project a4a1ede56045408594b1e923d145f7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:23:05.358797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.359401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.361064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1333/2675] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:23:05 2022] DELETE /identity/v3/projects/a4a1ede56045408594b1e923d145f7ad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:05.365222 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068310-a00a-4de3-9f95-54e41d05ad0f service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:05.375194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068310-a00a-4de3-9f95-54e41d05ad0f service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:05.393819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:05.436432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:05.437348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:05.437626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:05.437934 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] PATH_INFO: `/v3/users/7a36b16096414158b2a8b960754413a4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:05.439156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a36b16096414158b2a8b960754413a4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:05.441134 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:05.490965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a36b16096414158b2a8b960754413a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.491559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a36b16096414158b2a8b960754413a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.500318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a36b16096414158b2a8b960754413a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.507660 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a36b16096414158b2a8b960754413a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.520917 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5d931bf3-7276-463c-9b10-dd26c8310ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a36b16096414158b2a8b960754413a4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.527547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1343/2676] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:23:05 2022] DELETE /identity/v3/users/7a36b16096414158b2a8b960754413a4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:23:05.812311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:05.813780 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:05.829818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803565c-c81c-48c5-8399-923b4aaa69a0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:05.892231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:05.893129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:05.893414 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:05.893688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] PATH_INFO: `/v3/projects/94b9036aacc94be5ad62968cab9f9e12` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:05.895102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b9036aacc94be5ad62968cab9f9e12)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:05.897518 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:05.932947 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:05.952288 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b9036aacc94be5ad62968cab9f9e12', 'request_id': 'req-0d1c7825-01e7-4c02-961e-85b540948833'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.957922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b9036aacc94be5ad62968cab9f9e12', 'request_id': 'req-0d1c7825-01e7-4c02-961e-85b540948833'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.964453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b9036aacc94be5ad62968cab9f9e12', 'request_id': 'req-0d1c7825-01e7-4c02-961e-85b540948833'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.978407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] The token cache is being invalidate because project 94b9036aacc94be5ad62968cab9f9e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:23:05.978697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.979331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-0d1c7825-01e7-4c02-961e-85b540948833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:05.980914 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1334/2677] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:23:05 2022] DELETE /identity/v3/projects/94b9036aacc94be5ad62968cab9f9e12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:05.986044 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0521b-f8e6-4ba2-9b4c-96eed99d78da None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:05.986526 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0521b-f8e6-4ba2-9b4c-96eed99d78da None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:05.986643 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0521b-f8e6-4ba2-9b4c-96eed99d78da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.005435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7aa0521b-f8e6-4ba2-9b4c-96eed99d78da None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:06.006618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7aa0521b-f8e6-4ba2-9b4c-96eed99d78da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:06.080451 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1344/2678] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:23:06.088700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b291d6-578c-442e-8364-2fbb9c7c7f0b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.088993 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b291d6-578c-442e-8364-2fbb9c7c7f0b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.089267 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b291d6-578c-442e-8364-2fbb9c7c7f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.108880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-66b291d6-578c-442e-8364-2fbb9c7c7f0b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:06.110137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-66b291d6-578c-442e-8364-2fbb9c7c7f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:06.118772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1335/2679] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:06.123262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0521b-f8e6-4ba2-9b4c-96eed99d78da None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.133356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0521b-f8e6-4ba2-9b4c-96eed99d78da None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.138334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.138984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.139263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.139534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.140261 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:23:06.140561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.142184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.154160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1345/2680] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:23:06.158520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b291d6-578c-442e-8364-2fbb9c7c7f0b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.168011 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b291d6-578c-442e-8364-2fbb9c7c7f0b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.174245 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60f0f-cbcf-4abb-a7b8-f04f6231f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.174899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60f0f-cbcf-4abb-a7b8-f04f6231f21b admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.175164 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60f0f-cbcf-4abb-a7b8-f04f6231f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.175435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60f0f-cbcf-4abb-a7b8-f04f6231f21b admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.176117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60f0f-cbcf-4abb-a7b8-f04f6231f21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.178032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60f0f-cbcf-4abb-a7b8-f04f6231f21b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.209265 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1336/2681] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:23:06 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:06.213510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.223487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeee3b-f532-4373-a6e0-66e00f680312 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.249916 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:06.283752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d336f13-91c7-453b-8136-4a99a7e541a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.284420 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d336f13-91c7-453b-8136-4a99a7e541a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.284705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d336f13-91c7-453b-8136-4a99a7e541a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.284984 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d336f13-91c7-453b-8136-4a99a7e541a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.285680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d336f13-91c7-453b-8136-4a99a7e541a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.287812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d336f13-91c7-453b-8136-4a99a7e541a1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.312537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1346/2682] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:23:06 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:06.316690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60f0f-cbcf-4abb-a7b8-f04f6231f21b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.329123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60f0f-cbcf-4abb-a7b8-f04f6231f21b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.336499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447bd7a-433b-4647-9922-957322d2efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.337188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447bd7a-433b-4647-9922-957322d2efb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.337468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447bd7a-433b-4647-9922-957322d2efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.337735 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447bd7a-433b-4647-9922-957322d2efb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.338493 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447bd7a-433b-4647-9922-957322d2efb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.340181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447bd7a-433b-4647-9922-957322d2efb5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.350802 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1337/2683] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:06.354814 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d336f13-91c7-453b-8136-4a99a7e541a1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.365818 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d336f13-91c7-453b-8136-4a99a7e541a1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.372481 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa1c74-5a4b-4579-a84f-1d1ff8ad7198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.373165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa1c74-5a4b-4579-a84f-1d1ff8ad7198 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.373444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa1c74-5a4b-4579-a84f-1d1ff8ad7198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.373703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa1c74-5a4b-4579-a84f-1d1ff8ad7198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.374584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa1c74-5a4b-4579-a84f-1d1ff8ad7198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.376177 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa1c74-5a4b-4579-a84f-1d1ff8ad7198 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.387479 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1347/2684] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:06.394068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447bd7a-433b-4647-9922-957322d2efb5 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.404843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447bd7a-433b-4647-9922-957322d2efb5 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.409686 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a0672-5ac1-404c-8b82-5a9ef2943389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.410599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0672-5ac1-404c-8b82-5a9ef2943389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.410876 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0672-5ac1-404c-8b82-5a9ef2943389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.411127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0672-5ac1-404c-8b82-5a9ef2943389 admin admin] PATH_INFO: `/v3/projects/49d61957ec4a463586996d1c9f829291/users/cbb087eb25b849819f519d83183532e3/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.426587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a0672-5ac1-404c-8b82-5a9ef2943389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d61957ec4a463586996d1c9f829291, user_id=cbb087eb25b849819f519d83183532e3, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.429704 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a0672-5ac1-404c-8b82-5a9ef2943389 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.446201 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1338/2685] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:06 2022] PUT /identity/v3/projects/49d61957ec4a463586996d1c9f829291/users/cbb087eb25b849819f519d83183532e3/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:06.457356 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b34-fad1-4b68-b67f-7e2da6cf47b2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.457664 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b34-fad1-4b68-b67f-7e2da6cf47b2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.458213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03b34-fad1-4b68-b67f-7e2da6cf47b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.485661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-03b03b34-fad1-4b68-b67f-7e2da6cf47b2 None None] MFA Rules not processed for user `cbb087eb25b849819f519d83183532e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:06.486911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-03b03b34-fad1-4b68-b67f-7e2da6cf47b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:06.554491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1348/2686] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:06.559034 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a0672-5ac1-404c-8b82-5a9ef2943389 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.624652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a0672-5ac1-404c-8b82-5a9ef2943389 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.631386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6c09f-c07c-48ee-af2b-dcadcee17b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.632109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6c09f-c07c-48ee-af2b-dcadcee17b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.632422 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6c09f-c07c-48ee-af2b-dcadcee17b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.632767 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6c09f-c07c-48ee-af2b-dcadcee17b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.633468 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6c09f-c07c-48ee-af2b-dcadcee17b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.635457 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6c09f-c07c-48ee-af2b-dcadcee17b81 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.665116 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1339/2687] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:23:06 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:06.669342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03b34-fad1-4b68-b67f-7e2da6cf47b2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.680897 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03b34-fad1-4b68-b67f-7e2da6cf47b2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.740052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6477217-0d41-43cd-9389-f13ac893f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.740730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477217-0d41-43cd-9389-f13ac893f144 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.741009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477217-0d41-43cd-9389-f13ac893f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.741289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477217-0d41-43cd-9389-f13ac893f144 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.742019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6477217-0d41-43cd-9389-f13ac893f144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.743951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6477217-0d41-43cd-9389-f13ac893f144 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.773783 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1349/2688] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:23:06 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:06.780287 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6c09f-c07c-48ee-af2b-dcadcee17b81 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.792807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6c09f-c07c-48ee-af2b-dcadcee17b81 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.797635 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf60f9-141b-4a88-b19a-2087bb7881f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.798332 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf60f9-141b-4a88-b19a-2087bb7881f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.798608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf60f9-141b-4a88-b19a-2087bb7881f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.798881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf60f9-141b-4a88-b19a-2087bb7881f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.799587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf60f9-141b-4a88-b19a-2087bb7881f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.801225 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf60f9-141b-4a88-b19a-2087bb7881f0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.812611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1340/2689] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:06.816995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6477217-0d41-43cd-9389-f13ac893f144 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.827435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6477217-0d41-43cd-9389-f13ac893f144 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.832999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cef86-f615-401f-bedf-7554798aed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.834296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cef86-f615-401f-bedf-7554798aed39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.834575 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cef86-f615-401f-bedf-7554798aed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.834856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cef86-f615-401f-bedf-7554798aed39 admin admin] PATH_INFO: `/v3/projects/f562503f9f5344979810600bfa80e719/users/ed2b069540cd4efb88f0a71565386bee/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.850893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cef86-f615-401f-bedf-7554798aed39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f562503f9f5344979810600bfa80e719, user_id=ed2b069540cd4efb88f0a71565386bee, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.853517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cef86-f615-401f-bedf-7554798aed39 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.868533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1350/2690] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:06 2022] PUT /identity/v3/projects/f562503f9f5344979810600bfa80e719/users/ed2b069540cd4efb88f0a71565386bee/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:06.872900 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf60f9-141b-4a88-b19a-2087bb7881f0 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.883001 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf60f9-141b-4a88-b19a-2087bb7881f0 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.903616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:06.944750 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09f1fa-228b-4242-b843-4ddd7a0b54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.945426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09f1fa-228b-4242-b843-4ddd7a0b54cf admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.945713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09f1fa-228b-4242-b843-4ddd7a0b54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.946018 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09f1fa-228b-4242-b843-4ddd7a0b54cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.946758 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09f1fa-228b-4242-b843-4ddd7a0b54cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.948354 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09f1fa-228b-4242-b843-4ddd7a0b54cf admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.958283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1341/2691] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:06.962645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cef86-f615-401f-bedf-7554798aed39 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:06.968132 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:06.974447 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cef86-f615-401f-bedf-7554798aed39 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:06.979641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:06.980523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:06.980800 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:06.981071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] PATH_INFO: `/v3/projects/f562503f9f5344979810600bfa80e719/users/ed2b069540cd4efb88f0a71565386bee/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:06.983098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f562503f9f5344979810600bfa80e719, user_id=ed2b069540cd4efb88f0a71565386bee, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:06.985735 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:06.996291 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1351/2692] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:06 2022] PUT /identity/v3/projects/f562503f9f5344979810600bfa80e719/users/ed2b069540cd4efb88f0a71565386bee/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:07.007666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f3d9-ce0c-4d01-8402-74bc1dc9efce None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:07.007963 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f3d9-ce0c-4d01-8402-74bc1dc9efce None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:07.008228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f3d9-ce0c-4d01-8402-74bc1dc9efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:07.045742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-64e6f3d9-ce0c-4d01-8402-74bc1dc9efce None None] MFA Rules not processed for user `ed2b069540cd4efb88f0a71565386bee`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:07.047871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-64e6f3d9-ce0c-4d01-8402-74bc1dc9efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:07.120022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1342/2693] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:07.131835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:07.135012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:07.199566 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4856f-32a8-49a4-aee1-1c127d481c8f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:07.203263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74e544-a3f9-479b-b041-46d0307740ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:07.203908 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e544-a3f9-479b-b041-46d0307740ac service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:07.204187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e544-a3f9-479b-b041-46d0307740ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:07.204458 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e544-a3f9-479b-b041-46d0307740ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:07.213277 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74e544-a3f9-479b-b041-46d0307740ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:07.214728 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74e544-a3f9-479b-b041-46d0307740ac service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:07.224187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1352/2694] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:07.297108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f3d9-ce0c-4d01-8402-74bc1dc9efce None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:07.365645 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f3d9-ce0c-4d01-8402-74bc1dc9efce None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:07.371241 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:07.372066 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:07.372348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:07.372627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] PATH_INFO: `/v3/users/cbb087eb25b849819f519d83183532e3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:07.373898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb087eb25b849819f519d83183532e3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:07.375849 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:07.432124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb087eb25b849819f519d83183532e3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:07.433820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:07.441880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb087eb25b849819f519d83183532e3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:07.454401 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb087eb25b849819f519d83183532e3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:07.461224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb087eb25b849819f519d83183532e3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:07.461997 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb087eb25b849819f519d83183532e3'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:07.468342 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1343/2695] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:23:07 2022] DELETE /identity/v3/users/cbb087eb25b849819f519d83183532e3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:07.473125 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ff31-fe75-48e5-a600-095a9ca2f8e7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:07.473413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ff31-fe75-48e5-a600-095a9ca2f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:07.473688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ff31-fe75-48e5-a600-095a9ca2f8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:07.493577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-12e9ff31-fe75-48e5-a600-095a9ca2f8e7 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:07.494805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-12e9ff31-fe75-48e5-a600-095a9ca2f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:07.557182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1353/2696] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:07.567311 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:07.569031 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:07.628410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f9aed-4bc0-43a0-9737-1da1d0f6301a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:07.632107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cc255-bcd2-4021-a8d5-66a4c0ce7252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:07.632761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cc255-bcd2-4021-a8d5-66a4c0ce7252 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:07.633044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cc255-bcd2-4021-a8d5-66a4c0ce7252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:07.633319 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cc255-bcd2-4021-a8d5-66a4c0ce7252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:07.642393 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cc255-bcd2-4021-a8d5-66a4c0ce7252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:07.643818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cc255-bcd2-4021-a8d5-66a4c0ce7252 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:07.654912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1344/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:07.931370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9ff31-fe75-48e5-a600-095a9ca2f8e7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:07.932952 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-12e9ff31-fe75-48e5-a600-095a9ca2f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:07.945627 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9ff31-fe75-48e5-a600-095a9ca2f8e7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:07.951527 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:07.952433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:07.952712 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:07.952982 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] PATH_INFO: `/v3/projects/49d61957ec4a463586996d1c9f829291` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:07.954379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d61957ec4a463586996d1c9f829291)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:07.956751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:08.013322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d61957ec4a463586996d1c9f829291', 'request_id': 'req-e9c4484e-e684-4802-8b45-dfeb4e9382e2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.022555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d61957ec4a463586996d1c9f829291', 'request_id': 'req-e9c4484e-e684-4802-8b45-dfeb4e9382e2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.032530 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d61957ec4a463586996d1c9f829291', 'request_id': 'req-e9c4484e-e684-4802-8b45-dfeb4e9382e2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.053605 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] The token cache is being invalidate because project 49d61957ec4a463586996d1c9f829291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:23:08.053919 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.054872 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.056446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1354/2698] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:23:07 2022] DELETE /identity/v3/projects/49d61957ec4a463586996d1c9f829291 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:08.060701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cc255-bcd2-4021-a8d5-66a4c0ce7252 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:08.071639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cc255-bcd2-4021-a8d5-66a4c0ce7252 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:08.133118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:08.134076 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:08.134348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:08.134620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] PATH_INFO: `/v3/users/ed2b069540cd4efb88f0a71565386bee` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:08.136033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2b069540cd4efb88f0a71565386bee)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:08.137953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:08.195838 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2b069540cd4efb88f0a71565386bee'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.206317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2b069540cd4efb88f0a71565386bee'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.219106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:08.220928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2b069540cd4efb88f0a71565386bee'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.229458 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2b069540cd4efb88f0a71565386bee'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.230130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f16f4a17-9cc9-4ba8-9612-15b0ad9dd3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2b069540cd4efb88f0a71565386bee'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.239333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1345/2699] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:23:08 2022] DELETE /identity/v3/users/ed2b069540cd4efb88f0a71565386bee => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:08.528760 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:08.530340 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:08.545296 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4484e-e684-4802-8b45-dfeb4e9382e2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:08.560199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:08.609165 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:08.610078 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:08.610355 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:08.610647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] PATH_INFO: `/v3/projects/f562503f9f5344979810600bfa80e719` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:08.611871 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f562503f9f5344979810600bfa80e719)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:08.613781 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:08.663319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f562503f9f5344979810600bfa80e719', 'request_id': 'req-a495c4eb-09e1-4135-9e0f-f55f4728eae6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.669054 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f562503f9f5344979810600bfa80e719', 'request_id': 'req-a495c4eb-09e1-4135-9e0f-f55f4728eae6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.675680 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f562503f9f5344979810600bfa80e719', 'request_id': 'req-a495c4eb-09e1-4135-9e0f-f55f4728eae6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.696540 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] The token cache is being invalidate because project f562503f9f5344979810600bfa80e719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:23:08.696835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.697539 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a495c4eb-09e1-4135-9e0f-f55f4728eae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:08.699230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1355/2700] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:23:08 2022] DELETE /identity/v3/projects/f562503f9f5344979810600bfa80e719 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:08.704381 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aad85-d158-4f08-b6d0-87fd1a646109 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:08.704673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aad85-d158-4f08-b6d0-87fd1a646109 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:08.704969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aad85-d158-4f08-b6d0-87fd1a646109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:08.723454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-8d5aad85-d158-4f08-b6d0-87fd1a646109 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:08.724658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-8d5aad85-d158-4f08-b6d0-87fd1a646109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:08.783808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1346/2701] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:08.796349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d6d95-cbbf-4c52-ab96-fc9cc12f6375 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:08.796693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d6d95-cbbf-4c52-ab96-fc9cc12f6375 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:08.797060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d6d95-cbbf-4c52-ab96-fc9cc12f6375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:08.818750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-275d6d95-cbbf-4c52-ab96-fc9cc12f6375 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:08.820092 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-275d6d95-cbbf-4c52-ab96-fc9cc12f6375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:08.828640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1356/2702] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:08.833687 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aad85-d158-4f08-b6d0-87fd1a646109 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:08.846783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aad85-d158-4f08-b6d0-87fd1a646109 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:08.854834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:08.855788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:08.856133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:08.856470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:08.857708 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:23:08.858101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:08.860281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:08.874132 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1347/2703] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:23:08.878729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d6d95-cbbf-4c52-ab96-fc9cc12f6375 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:08.888590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d6d95-cbbf-4c52-ab96-fc9cc12f6375 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:08.894449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b940846-59b0-4940-8b1e-1eac0c1e1379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:08.895110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b940846-59b0-4940-8b1e-1eac0c1e1379 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:08.895388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b940846-59b0-4940-8b1e-1eac0c1e1379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:08.895655 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b940846-59b0-4940-8b1e-1eac0c1e1379 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:08.896386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b940846-59b0-4940-8b1e-1eac0c1e1379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:08.898532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b940846-59b0-4940-8b1e-1eac0c1e1379 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:08.926843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1357/2704] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:23:08 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:08.931569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:08.942163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530cdbb-3356-4988-833b-e365f6f6baf4 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.009423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365679a-ef6e-423c-a29c-85ea150c7322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.010137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365679a-ef6e-423c-a29c-85ea150c7322 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.010420 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365679a-ef6e-423c-a29c-85ea150c7322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.010689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365679a-ef6e-423c-a29c-85ea150c7322 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.011398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365679a-ef6e-423c-a29c-85ea150c7322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.013344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365679a-ef6e-423c-a29c-85ea150c7322 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.036357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1348/2705] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:23:08 2022] POST /identity/v3/users => generated 304 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:09.039616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b940846-59b0-4940-8b1e-1eac0c1e1379 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.050010 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b940846-59b0-4940-8b1e-1eac0c1e1379 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.055689 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0b473-0f48-4c79-bdc4-4aa53b7ea855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.056345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0b473-0f48-4c79-bdc4-4aa53b7ea855 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.056626 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0b473-0f48-4c79-bdc4-4aa53b7ea855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.056896 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0b473-0f48-4c79-bdc4-4aa53b7ea855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.057629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0b473-0f48-4c79-bdc4-4aa53b7ea855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.059258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0b473-0f48-4c79-bdc4-4aa53b7ea855 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.073167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1358/2706] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:23:09.079248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365679a-ef6e-423c-a29c-85ea150c7322 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.095383 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365679a-ef6e-423c-a29c-85ea150c7322 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.102994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0fc98-41b3-4b58-aceb-b202a3ad7664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.103672 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0fc98-41b3-4b58-aceb-b202a3ad7664 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.103951 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0fc98-41b3-4b58-aceb-b202a3ad7664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.104218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0fc98-41b3-4b58-aceb-b202a3ad7664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.104943 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0fc98-41b3-4b58-aceb-b202a3ad7664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.106557 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0fc98-41b3-4b58-aceb-b202a3ad7664 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.117204 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1349/2707] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:09.121386 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0b473-0f48-4c79-bdc4-4aa53b7ea855 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.131430 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0b473-0f48-4c79-bdc4-4aa53b7ea855 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.136461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2bd8f-1c24-440f-81fd-291be839eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.137380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2bd8f-1c24-440f-81fd-291be839eeed admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.137661 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2bd8f-1c24-440f-81fd-291be839eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.137976 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2bd8f-1c24-440f-81fd-291be839eeed admin admin] PATH_INFO: `/v3/projects/08fb627116834797bfd6f6daab834b6c/users/a5208f20aa254a7fb08d9b9b37e114a0/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.153806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2bd8f-1c24-440f-81fd-291be839eeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fb627116834797bfd6f6daab834b6c, user_id=a5208f20aa254a7fb08d9b9b37e114a0, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.156480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2bd8f-1c24-440f-81fd-291be839eeed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.172787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1359/2708] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:09 2022] PUT /identity/v3/projects/08fb627116834797bfd6f6daab834b6c/users/a5208f20aa254a7fb08d9b9b37e114a0/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:09.184214 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131f5fa-5d69-453d-84b1-1b9fd775714d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.184560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131f5fa-5d69-453d-84b1-1b9fd775714d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.184833 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131f5fa-5d69-453d-84b1-1b9fd775714d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.213905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-9131f5fa-5d69-453d-84b1-1b9fd775714d None None] MFA Rules not processed for user `a5208f20aa254a7fb08d9b9b37e114a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:09.215148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-9131f5fa-5d69-453d-84b1-1b9fd775714d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:09.259167 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:09.289654 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1350/2709] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:09.293981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2bd8f-1c24-440f-81fd-291be839eeed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.341413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:09.361752 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2bd8f-1c24-440f-81fd-291be839eeed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.367058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16149011-6274-4137-baf9-7d175d6e7667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.367739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16149011-6274-4137-baf9-7d175d6e7667 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.368021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16149011-6274-4137-baf9-7d175d6e7667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.368307 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16149011-6274-4137-baf9-7d175d6e7667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.368999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16149011-6274-4137-baf9-7d175d6e7667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.370930 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16149011-6274-4137-baf9-7d175d6e7667 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.399105 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1360/2710] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:23:09 2022] POST /identity/v3/projects => generated 409 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:09.403324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131f5fa-5d69-453d-84b1-1b9fd775714d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.414321 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131f5fa-5d69-453d-84b1-1b9fd775714d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.479144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f77fbf-42fc-4760-820b-04c425e4b7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.479754 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77fbf-42fc-4760-820b-04c425e4b7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.480032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77fbf-42fc-4760-820b-04c425e4b7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.480303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77fbf-42fc-4760-820b-04c425e4b7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.480992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f77fbf-42fc-4760-820b-04c425e4b7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.483033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f77fbf-42fc-4760-820b-04c425e4b7f5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.502916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1351/2711] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:23:09 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:09.507126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16149011-6274-4137-baf9-7d175d6e7667 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.517948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16149011-6274-4137-baf9-7d175d6e7667 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.523778 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960e1e-ddc8-4bd5-b985-ff8bc3019f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.524473 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960e1e-ddc8-4bd5-b985-ff8bc3019f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.524733 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960e1e-ddc8-4bd5-b985-ff8bc3019f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.525005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960e1e-ddc8-4bd5-b985-ff8bc3019f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.525738 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a960e1e-ddc8-4bd5-b985-ff8bc3019f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.527367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a960e1e-ddc8-4bd5-b985-ff8bc3019f69 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.539176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1361/2712] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:09.544212 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f77fbf-42fc-4760-820b-04c425e4b7f5 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.558866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f77fbf-42fc-4760-820b-04c425e4b7f5 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.564439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b7bb7-ad13-4e7f-bfd9-5493f6dbb0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.565331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b7bb7-ad13-4e7f-bfd9-5493f6dbb0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.565606 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b7bb7-ad13-4e7f-bfd9-5493f6dbb0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.565910 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b7bb7-ad13-4e7f-bfd9-5493f6dbb0aa admin admin] PATH_INFO: `/v3/projects/7dcec473f0b3443ba0281933b73007d3/users/6a622ff0a2c943f69e610c5717bf8afd/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.582196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b7bb7-ad13-4e7f-bfd9-5493f6dbb0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dcec473f0b3443ba0281933b73007d3, user_id=6a622ff0a2c943f69e610c5717bf8afd, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.585065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b7bb7-ad13-4e7f-bfd9-5493f6dbb0aa admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.605771 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1352/2713] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:09 2022] PUT /identity/v3/projects/7dcec473f0b3443ba0281933b73007d3/users/6a622ff0a2c943f69e610c5717bf8afd/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:09.611594 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960e1e-ddc8-4bd5-b985-ff8bc3019f69 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.624475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960e1e-ddc8-4bd5-b985-ff8bc3019f69 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.691807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36b06c-d8a0-4ce1-9809-ba114effb6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.692491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b06c-d8a0-4ce1-9809-ba114effb6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.692771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b06c-d8a0-4ce1-9809-ba114effb6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.693043 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b06c-d8a0-4ce1-9809-ba114effb6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.693890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36b06c-d8a0-4ce1-9809-ba114effb6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.695492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36b06c-d8a0-4ce1-9809-ba114effb6a3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.705621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1362/2714] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:09.710096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b7bb7-ad13-4e7f-bfd9-5493f6dbb0aa admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.720644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b7bb7-ad13-4e7f-bfd9-5493f6dbb0aa admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.725921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.726812 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.727095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.727369 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] PATH_INFO: `/v3/projects/7dcec473f0b3443ba0281933b73007d3/users/6a622ff0a2c943f69e610c5717bf8afd/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.729527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dcec473f0b3443ba0281933b73007d3, user_id=6a622ff0a2c943f69e610c5717bf8afd, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.732222 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.743251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1353/2715] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:09 2022] PUT /identity/v3/projects/7dcec473f0b3443ba0281933b73007d3/users/6a622ff0a2c943f69e610c5717bf8afd/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:09.754625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4b29-6388-4d6c-a7bd-b331ba6ed99d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.754899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4b29-6388-4d6c-a7bd-b331ba6ed99d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.755176 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4b29-6388-4d6c-a7bd-b331ba6ed99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.782770 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-eeed4b29-6388-4d6c-a7bd-b331ba6ed99d None None] MFA Rules not processed for user `6a622ff0a2c943f69e610c5717bf8afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:09.783985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eeed4b29-6388-4d6c-a7bd-b331ba6ed99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:09.853808 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1363/2716] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:09.870119 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:09.872193 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:09.932913 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c600bd6-91d5-4c43-9c86-a5ebb0c2b70b admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:09.936905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:09.937553 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:09.937820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:09.938130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:09.947639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:09.949078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:09.958684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1354/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:10.113915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed4b29-6388-4d6c-a7bd-b331ba6ed99d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:10.124780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed4b29-6388-4d6c-a7bd-b331ba6ed99d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:10.129405 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5f365-6458-4c8b-bf04-726a438eb592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:10.130079 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5f365-6458-4c8b-bf04-726a438eb592 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:10.130352 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5f365-6458-4c8b-bf04-726a438eb592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:10.130623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5f365-6458-4c8b-bf04-726a438eb592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:10.166055 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:10.191365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5f365-6458-4c8b-bf04-726a438eb592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:10.192831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5f365-6458-4c8b-bf04-726a438eb592 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:10.201739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1364/2718] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:10 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:15.984854 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:15.986514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:16.041216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:16.058823 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebeeb4-b067-4e7d-956d-b27eb1e5f3e3 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:16.062793 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e4f4f-0e66-4e89-9572-a9514bff5df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:16.063441 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4f4f-0e66-4e89-9572-a9514bff5df3 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:16.063718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4f4f-0e66-4e89-9572-a9514bff5df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:16.063990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4f4f-0e66-4e89-9572-a9514bff5df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:16.065983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ec9e4f4f-0e66-4e89-9572-a9514bff5df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:16.076404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e4f4f-0e66-4e89-9572-a9514bff5df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:16.077820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e4f4f-0e66-4e89-9572-a9514bff5df3 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:16.086051 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1355/2719] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:19.688740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5f365-6458-4c8b-bf04-726a438eb592 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:19.757787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5f365-6458-4c8b-bf04-726a438eb592 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:19.763067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:19.763945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:19.764209 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:19.764506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] PATH_INFO: `/v3/users/a5208f20aa254a7fb08d9b9b37e114a0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:19.765714 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5208f20aa254a7fb08d9b9b37e114a0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:19.767698 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:19.826349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5208f20aa254a7fb08d9b9b37e114a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:19.827015 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5208f20aa254a7fb08d9b9b37e114a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:19.838954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5208f20aa254a7fb08d9b9b37e114a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:19.846421 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5208f20aa254a7fb08d9b9b37e114a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:19.859312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5208f20aa254a7fb08d9b9b37e114a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:19.865843 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1365/2720] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:23:19 2022] DELETE /identity/v3/users/a5208f20aa254a7fb08d9b9b37e114a0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:19.871424 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9e36-8a74-4185-a94a-87f6591fabb6 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:19.871911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9e36-8a74-4185-a94a-87f6591fabb6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:19.872006 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9e36-8a74-4185-a94a-87f6591fabb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:19.892683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a6ca9e36-8a74-4185-a94a-87f6591fabb6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:19.894007 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a6ca9e36-8a74-4185-a94a-87f6591fabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:19.959020 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1356/2721] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:19.969073 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:19.970690 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:20.037361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1af96-aaf1-4cf3-a6b2-339d7578752e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:20.042790 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1ceb6-6697-48af-a330-4184b658d631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:20.043475 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1ceb6-6697-48af-a330-4184b658d631 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:20.043753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1ceb6-6697-48af-a330-4184b658d631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:20.044020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1ceb6-6697-48af-a330-4184b658d631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:20.055856 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1ceb6-6697-48af-a330-4184b658d631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:20.057359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1ceb6-6697-48af-a330-4184b658d631 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:20.061220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:20.068071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1366/2722] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:20.351227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9e36-8a74-4185-a94a-87f6591fabb6 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:20.352848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a6ca9e36-8a74-4185-a94a-87f6591fabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:20.365508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9e36-8a74-4185-a94a-87f6591fabb6 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:20.371232 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:20.372130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:20.372416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:20.372693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] PATH_INFO: `/v3/projects/08fb627116834797bfd6f6daab834b6c` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:20.374071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fb627116834797bfd6f6daab834b6c)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:20.376019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:20.426690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fb627116834797bfd6f6daab834b6c', 'request_id': 'req-2207dc64-673f-4fca-8be2-667ffbed9fb2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.432846 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fb627116834797bfd6f6daab834b6c', 'request_id': 'req-2207dc64-673f-4fca-8be2-667ffbed9fb2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.439199 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fb627116834797bfd6f6daab834b6c', 'request_id': 'req-2207dc64-673f-4fca-8be2-667ffbed9fb2'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.453569 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] The token cache is being invalidate because project 08fb627116834797bfd6f6daab834b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:23:20.453944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.454851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.456568 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1357/2723] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:23:20 2022] DELETE /identity/v3/projects/08fb627116834797bfd6f6daab834b6c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:20.460789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1ceb6-6697-48af-a330-4184b658d631 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:20.471083 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1ceb6-6697-48af-a330-4184b658d631 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:20.541460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:20.542371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:20.542653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:20.542986 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] PATH_INFO: `/v3/users/6a622ff0a2c943f69e610c5717bf8afd` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:20.544131 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a622ff0a2c943f69e610c5717bf8afd)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:20.546074 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:20.598230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a622ff0a2c943f69e610c5717bf8afd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.598879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a622ff0a2c943f69e610c5717bf8afd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.607397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a622ff0a2c943f69e610c5717bf8afd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.614480 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a622ff0a2c943f69e610c5717bf8afd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.626810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d5e3a50e-0c1f-45ef-8549-19c3c0cb8a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a622ff0a2c943f69e610c5717bf8afd'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:20.633911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1367/2724] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:23:20 2022] DELETE /identity/v3/users/6a622ff0a2c943f69e610c5717bf8afd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:20.916690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:20.918213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:20.933489 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207dc64-673f-4fca-8be2-667ffbed9fb2 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:20.991739 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:20.992623 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:20.992904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:20.993183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] PATH_INFO: `/v3/projects/7dcec473f0b3443ba0281933b73007d3` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:20.994446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dcec473f0b3443ba0281933b73007d3)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:20.996397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:21.003246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:21.049095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dcec473f0b3443ba0281933b73007d3', 'request_id': 'req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:21.055109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dcec473f0b3443ba0281933b73007d3', 'request_id': 'req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:21.061279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dcec473f0b3443ba0281933b73007d3', 'request_id': 'req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:21.076512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] The token cache is being invalidate because project 7dcec473f0b3443ba0281933b73007d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:23:21.076856 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:21.077599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f33a42c4-a9cb-427b-96cd-dcc92dcb4d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:21.079543 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1358/2725] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:23:20 2022] DELETE /identity/v3/projects/7dcec473f0b3443ba0281933b73007d3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:21.086152 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b542-3bc2-40df-a03a-813e8783b131 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.086702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b542-3bc2-40df-a03a-813e8783b131 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.086702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b542-3bc2-40df-a03a-813e8783b131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.107713 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7e72b542-3bc2-40df-a03a-813e8783b131 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:21.108936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7e72b542-3bc2-40df-a03a-813e8783b131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:21.181319 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1368/2726] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:21.192728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281798fc-3676-4ef2-bc47-7fac83e81bfd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.193012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281798fc-3676-4ef2-bc47-7fac83e81bfd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.193292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281798fc-3676-4ef2-bc47-7fac83e81bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.215349 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-281798fc-3676-4ef2-bc47-7fac83e81bfd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:21.216652 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-281798fc-3676-4ef2-bc47-7fac83e81bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:21.225504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1359/2727] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:21.230014 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72b542-3bc2-40df-a03a-813e8783b131 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:21.239951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72b542-3bc2-40df-a03a-813e8783b131 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:21.245629 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:21.246343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.246634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.246913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.247662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:23:21.247973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:21.249570 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:21.264618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1369/2728] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:23:21.268950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281798fc-3676-4ef2-bc47-7fac83e81bfd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:21.279023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281798fc-3676-4ef2-bc47-7fac83e81bfd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:21.286237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3604-6bd9-4b48-baa0-fc61b23a698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:21.286931 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3604-6bd9-4b48-baa0-fc61b23a698a admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.287210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3604-6bd9-4b48-baa0-fc61b23a698a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.287477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3604-6bd9-4b48-baa0-fc61b23a698a admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.288172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc3604-6bd9-4b48-baa0-fc61b23a698a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:21.290088 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc3604-6bd9-4b48-baa0-fc61b23a698a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:21.319372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1360/2729] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:23:21 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:21.323707 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:21.330233 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:21.334120 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9cb00-0896-4b6c-a4cf-ad70a1f1ca24 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:21.400349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725946dc-a98c-447f-8de1-d2855b583952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:21.401026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725946dc-a98c-447f-8de1-d2855b583952 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.401306 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725946dc-a98c-447f-8de1-d2855b583952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.401587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725946dc-a98c-447f-8de1-d2855b583952 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.402310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725946dc-a98c-447f-8de1-d2855b583952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:21.404231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725946dc-a98c-447f-8de1-d2855b583952 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:21.425276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1370/2730] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:23:21 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:21.429932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3604-6bd9-4b48-baa0-fc61b23a698a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:21.440611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3604-6bd9-4b48-baa0-fc61b23a698a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:21.446407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74029c38-457b-4c69-a827-c16992f44e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:21.447348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029c38-457b-4c69-a827-c16992f44e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.447648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029c38-457b-4c69-a827-c16992f44e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.447965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029c38-457b-4c69-a827-c16992f44e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.449068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74029c38-457b-4c69-a827-c16992f44e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:21.451701 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74029c38-457b-4c69-a827-c16992f44e2a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:21.465926 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1361/2731] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:21.470557 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725946dc-a98c-447f-8de1-d2855b583952 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:21.486412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725946dc-a98c-447f-8de1-d2855b583952 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:21.494551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31b4f0-845b-4e18-a1d7-f118128ed201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:21.495220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b4f0-845b-4e18-a1d7-f118128ed201 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.495494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b4f0-845b-4e18-a1d7-f118128ed201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.495730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b4f0-845b-4e18-a1d7-f118128ed201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.496470 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31b4f0-845b-4e18-a1d7-f118128ed201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:21.498103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31b4f0-845b-4e18-a1d7-f118128ed201 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:21.508577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1371/2732] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:23:21.512982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74029c38-457b-4c69-a827-c16992f44e2a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:21.523466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74029c38-457b-4c69-a827-c16992f44e2a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:21.529601 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:21.530512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.530788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.531059 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] PATH_INFO: `/v3/projects/7286f6357b9d428381a05748834a5989/users/a5c9d59698fe4aaaa1f3e3e72b0aef28/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.546277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7286f6357b9d428381a05748834a5989, user_id=a5c9d59698fe4aaaa1f3e3e72b0aef28, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:21.548920 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:21.564728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1362/2733] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:21 2022] PUT /identity/v3/projects/7286f6357b9d428381a05748834a5989/users/a5c9d59698fe4aaaa1f3e3e72b0aef28/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:21.576999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a806d4-7a5e-46e6-9896-e2aac53a576d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.577223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a806d4-7a5e-46e6-9896-e2aac53a576d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.577496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a806d4-7a5e-46e6-9896-e2aac53a576d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.606634 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-24a806d4-7a5e-46e6-9896-e2aac53a576d None None] MFA Rules not processed for user `a5c9d59698fe4aaaa1f3e3e72b0aef28`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:21.607860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-24a806d4-7a5e-46e6-9896-e2aac53a576d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:21.673500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1372/2734] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:21.684955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:21.686807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:21.750475 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab6d9b-4630-43a4-89c8-622baf4afb5f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:21.757525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445d6e7-f40b-446d-bfc9-49de70255703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:21.758534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d6e7-f40b-446d-bfc9-49de70255703 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:21.759047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d6e7-f40b-446d-bfc9-49de70255703 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:21.759309 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d6e7-f40b-446d-bfc9-49de70255703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:21.768820 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445d6e7-f40b-446d-bfc9-49de70255703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:21.770320 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445d6e7-f40b-446d-bfc9-49de70255703 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:21.779835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1363/2735] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:24.863365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a806d4-7a5e-46e6-9896-e2aac53a576d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:24.941678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a806d4-7a5e-46e6-9896-e2aac53a576d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:24.946873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:24.947767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:24.948022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:24.948342 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] PATH_INFO: `/v3/users/a5c9d59698fe4aaaa1f3e3e72b0aef28` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:24.949614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c9d59698fe4aaaa1f3e3e72b0aef28)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:24.951596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:24.967354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:25.005089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c9d59698fe4aaaa1f3e3e72b0aef28'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.005751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c9d59698fe4aaaa1f3e3e72b0aef28'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.014183 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c9d59698fe4aaaa1f3e3e72b0aef28'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.021022 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c9d59698fe4aaaa1f3e3e72b0aef28'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.032506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c9d59698fe4aaaa1f3e3e72b0aef28'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.038932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1373/2736] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:23:24 2022] DELETE /identity/v3/users/a5c9d59698fe4aaaa1f3e3e72b0aef28 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:25.043742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309ced-c2ac-49a7-89dc-438d6f7adcc1 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.044213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309ced-c2ac-49a7-89dc-438d6f7adcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.044310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0309ced-c2ac-49a7-89dc-438d6f7adcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.066566 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-c0309ced-c2ac-49a7-89dc-438d6f7adcc1 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:25.068313 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c0309ced-c2ac-49a7-89dc-438d6f7adcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:25.104689 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:25.141075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1364/2737] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:25.152615 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:25.154298 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:25.215207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0ce3-ce8a-4819-b785-d233346dc20a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:25.219929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbcc72-6d17-4991-b3ea-02ee2d50b51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:25.220583 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbcc72-6d17-4991-b3ea-02ee2d50b51c service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.220865 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbcc72-6d17-4991-b3ea-02ee2d50b51c service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.221141 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbcc72-6d17-4991-b3ea-02ee2d50b51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.231460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbcc72-6d17-4991-b3ea-02ee2d50b51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:25.232913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbcc72-6d17-4991-b3ea-02ee2d50b51c service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:25.243064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1374/2738] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:23:25.516877 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309ced-c2ac-49a7-89dc-438d6f7adcc1 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:25.518435 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c0309ced-c2ac-49a7-89dc-438d6f7adcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:25.533661 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0309ced-c2ac-49a7-89dc-438d6f7adcc1 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:25.539471 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:25.540356 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.540740 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.540919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] PATH_INFO: `/v3/projects/7286f6357b9d428381a05748834a5989` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.542224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7286f6357b9d428381a05748834a5989)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:25.544137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:25.595042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7286f6357b9d428381a05748834a5989', 'request_id': 'req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.601444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7286f6357b9d428381a05748834a5989', 'request_id': 'req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.608213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7286f6357b9d428381a05748834a5989', 'request_id': 'req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.623033 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] The token cache is being invalidate because project 7286f6357b9d428381a05748834a5989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:23:25.623317 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.623970 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-bd640b80-13e2-4669-8e0a-0d71d1afe7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:25.625663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1365/2739] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:23:25 2022] DELETE /identity/v3/projects/7286f6357b9d428381a05748834a5989 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:25.631771 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa568f2f-8503-44bf-8ec2-6b64e88f102b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.632058 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa568f2f-8503-44bf-8ec2-6b64e88f102b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.632329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa568f2f-8503-44bf-8ec2-6b64e88f102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.650361 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fa568f2f-8503-44bf-8ec2-6b64e88f102b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:25.651668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fa568f2f-8503-44bf-8ec2-6b64e88f102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:25.713608 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1375/2740] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:25.721613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781a190-4b78-4fd3-b408-f5f77d0e4cbd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.721942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781a190-4b78-4fd3-b408-f5f77d0e4cbd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.722238 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781a190-4b78-4fd3-b408-f5f77d0e4cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.740344 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e781a190-4b78-4fd3-b408-f5f77d0e4cbd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:25.741531 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e781a190-4b78-4fd3-b408-f5f77d0e4cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:25.750264 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1366/2741] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:25.755234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa568f2f-8503-44bf-8ec2-6b64e88f102b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:25.770853 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa568f2f-8503-44bf-8ec2-6b64e88f102b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:25.778672 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:25.779324 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.779601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.779867 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.780611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:23:25.780911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:25.782545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:25.794432 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1376/2742] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:23:25.798791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781a190-4b78-4fd3-b408-f5f77d0e4cbd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:25.809216 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781a190-4b78-4fd3-b408-f5f77d0e4cbd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:25.814240 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180c92e-0bcb-4714-88c2-a9212dff0999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:25.814893 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c92e-0bcb-4714-88c2-a9212dff0999 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.815171 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c92e-0bcb-4714-88c2-a9212dff0999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.815439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c92e-0bcb-4714-88c2-a9212dff0999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.816129 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180c92e-0bcb-4714-88c2-a9212dff0999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:25.818092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180c92e-0bcb-4714-88c2-a9212dff0999 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:25.845725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1367/2743] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:25.850138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:25.860545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8703b-85e8-42ed-b784-e468ab7243ef admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:25.879623 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:25.920197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826315f7-75d6-4f9d-a19e-6cf464818a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:25.920873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826315f7-75d6-4f9d-a19e-6cf464818a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.921149 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826315f7-75d6-4f9d-a19e-6cf464818a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.921415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826315f7-75d6-4f9d-a19e-6cf464818a6c admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.922139 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826315f7-75d6-4f9d-a19e-6cf464818a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:25.924048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826315f7-75d6-4f9d-a19e-6cf464818a6c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:25.946855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1377/2744] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:23:25 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:25.951097 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180c92e-0bcb-4714-88c2-a9212dff0999 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:25.961781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180c92e-0bcb-4714-88c2-a9212dff0999 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:25.967973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc641c6a-ad89-406d-9443-21b02a914fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:25.968644 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc641c6a-ad89-406d-9443-21b02a914fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:25.968911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc641c6a-ad89-406d-9443-21b02a914fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:25.969182 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc641c6a-ad89-406d-9443-21b02a914fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:25.969959 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc641c6a-ad89-406d-9443-21b02a914fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:25.971573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc641c6a-ad89-406d-9443-21b02a914fa5 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:25.983141 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1368/2745] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:25.987170 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826315f7-75d6-4f9d-a19e-6cf464818a6c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:26.000153 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826315f7-75d6-4f9d-a19e-6cf464818a6c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:26.004990 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15051d-f9d3-4883-8be5-58e7198fbb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:26.005645 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15051d-f9d3-4883-8be5-58e7198fbb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:26.005960 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15051d-f9d3-4883-8be5-58e7198fbb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:26.006243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15051d-f9d3-4883-8be5-58e7198fbb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:26.007006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15051d-f9d3-4883-8be5-58e7198fbb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:26.008601 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15051d-f9d3-4883-8be5-58e7198fbb5d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:26.018892 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1378/2746] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 17:23:26.023106 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc641c6a-ad89-406d-9443-21b02a914fa5 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:26.033552 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc641c6a-ad89-406d-9443-21b02a914fa5 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:26.039452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:26.040345 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:26.040626 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:26.040903 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] PATH_INFO: `/v3/projects/f0491a3492d94b6e9d9acae5a0717792/users/91f5313b2e9b4bf3b22e715deeb7d164/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:26.057300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0491a3492d94b6e9d9acae5a0717792, user_id=91f5313b2e9b4bf3b22e715deeb7d164, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:26.060172 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:26.076249 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1369/2747] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:26 2022] PUT /identity/v3/projects/f0491a3492d94b6e9d9acae5a0717792/users/91f5313b2e9b4bf3b22e715deeb7d164/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:23:26.086675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010d3d-9878-41a6-9378-839375bb3acb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:26.086970 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010d3d-9878-41a6-9378-839375bb3acb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:26.087251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010d3d-9878-41a6-9378-839375bb3acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:26.113402 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1d010d3d-9878-41a6-9378-839375bb3acb None None] MFA Rules not processed for user `91f5313b2e9b4bf3b22e715deeb7d164`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:26.114614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1d010d3d-9878-41a6-9378-839375bb3acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:26.177489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1379/2748] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:23:26.190065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:26.193197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:26.252848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7657a3-c604-48fe-83c1-4b22f6d33601 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:26.256924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03b7f9-f88f-4970-a3db-6397ee868bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:26.257537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b7f9-f88f-4970-a3db-6397ee868bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:26.257882 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b7f9-f88f-4970-a3db-6397ee868bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:26.258151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b7f9-f88f-4970-a3db-6397ee868bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:26.264807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:26.267210 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b7f9-f88f-4970-a3db-6397ee868bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:26.268658 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b7f9-f88f-4970-a3db-6397ee868bd7 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:26.278852 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1370/2749] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:28.855801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d010d3d-9878-41a6-9378-839375bb3acb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:28.924862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d010d3d-9878-41a6-9378-839375bb3acb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:28.930572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:28.931552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:28.931840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:28.932123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] PATH_INFO: `/v3/users/91f5313b2e9b4bf3b22e715deeb7d164` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:28.933422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f5313b2e9b4bf3b22e715deeb7d164)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:28.935997 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:28.976175 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:28.990882 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f5313b2e9b4bf3b22e715deeb7d164'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:28.991518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f5313b2e9b4bf3b22e715deeb7d164'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:28.999978 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f5313b2e9b4bf3b22e715deeb7d164'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:29.007148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f5313b2e9b4bf3b22e715deeb7d164'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:29.019863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f5313b2e9b4bf3b22e715deeb7d164'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:29.025890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1380/2750] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:23:28 2022] DELETE /identity/v3/users/91f5313b2e9b4bf3b22e715deeb7d164 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:29.030596 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19d219-d7f2-444b-b3bc-35a83da8e2c3 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.031118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19d219-d7f2-444b-b3bc-35a83da8e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.031118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19d219-d7f2-444b-b3bc-35a83da8e2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.051973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-2c19d219-d7f2-444b-b3bc-35a83da8e2c3 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:29.053747 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2c19d219-d7f2-444b-b3bc-35a83da8e2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:29.118109 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1371/2751] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:29.128013 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:29.129697 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:29.189226 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf0384-d8eb-44a7-871d-4fdfdb1f6773 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:29.193563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e26054-ad53-4660-a995-c220ec43ede4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:29.194239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26054-ad53-4660-a995-c220ec43ede4 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.194517 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26054-ad53-4660-a995-c220ec43ede4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.194788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e26054-ad53-4660-a995-c220ec43ede4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.204807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e26054-ad53-4660-a995-c220ec43ede4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:29.206279 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e26054-ad53-4660-a995-c220ec43ede4 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:29.216252 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1381/2752] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:29.502840 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19d219-d7f2-444b-b3bc-35a83da8e2c3 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:29.504438 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-2c19d219-d7f2-444b-b3bc-35a83da8e2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:29.516781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19d219-d7f2-444b-b3bc-35a83da8e2c3 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:29.521676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:29.522607 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.522887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.523166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] PATH_INFO: `/v3/projects/f0491a3492d94b6e9d9acae5a0717792` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.524433 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0491a3492d94b6e9d9acae5a0717792)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:29.526444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:29.576891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0491a3492d94b6e9d9acae5a0717792', 'request_id': 'req-07954e0f-5767-45b6-a4f9-9db4b9729464'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:29.582444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0491a3492d94b6e9d9acae5a0717792', 'request_id': 'req-07954e0f-5767-45b6-a4f9-9db4b9729464'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:29.588560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0491a3492d94b6e9d9acae5a0717792', 'request_id': 'req-07954e0f-5767-45b6-a4f9-9db4b9729464'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:29.604676 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] The token cache is being invalidate because project f0491a3492d94b6e9d9acae5a0717792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:23:29.604967 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:29.605583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-07954e0f-5767-45b6-a4f9-9db4b9729464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:23:29.607137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1372/2753] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:23:29 2022] DELETE /identity/v3/projects/f0491a3492d94b6e9d9acae5a0717792 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:29.612107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe562e4-56a2-48d8-8bff-69111afbff8a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.612393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe562e4-56a2-48d8-8bff-69111afbff8a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.612665 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe562e4-56a2-48d8-8bff-69111afbff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.632023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3fe562e4-56a2-48d8-8bff-69111afbff8a None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:29.633174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3fe562e4-56a2-48d8-8bff-69111afbff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:29.697510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1382/2754] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:29.706498 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d061c1-f9aa-4ec1-a449-e61f8c864356 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.706783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d061c1-f9aa-4ec1-a449-e61f8c864356 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.707058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d061c1-f9aa-4ec1-a449-e61f8c864356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.725599 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-91d061c1-f9aa-4ec1-a449-e61f8c864356 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:29.726826 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-91d061c1-f9aa-4ec1-a449-e61f8c864356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:29.736162 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1373/2755] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:29.740676 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe562e4-56a2-48d8-8bff-69111afbff8a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:29.751642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe562e4-56a2-48d8-8bff-69111afbff8a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:29.756554 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:29.757213 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.757497 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.757777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.758543 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:23:29.758854 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:29.760494 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:29.772706 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1383/2756] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:23:29.777144 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d061c1-f9aa-4ec1-a449-e61f8c864356 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:29.787048 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d061c1-f9aa-4ec1-a449-e61f8c864356 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:29.792375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5863-cf51-47be-8110-84636fb7cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:29.793079 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5863-cf51-47be-8110-84636fb7cf4e admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.793382 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5863-cf51-47be-8110-84636fb7cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.793681 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5863-cf51-47be-8110-84636fb7cf4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.794398 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5863-cf51-47be-8110-84636fb7cf4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:29.796335 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5863-cf51-47be-8110-84636fb7cf4e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:29.824357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1374/2757] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:23:29 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:29.828716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:29.839025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b23a1-da88-4151-8863-8b3a6a5c22fa admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:29.878755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:29.899415 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6b8c7-fbe0-4ad4-8d75-82f8b15e075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:29.900028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b8c7-fbe0-4ad4-8d75-82f8b15e075e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.900312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b8c7-fbe0-4ad4-8d75-82f8b15e075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.900593 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b8c7-fbe0-4ad4-8d75-82f8b15e075e admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.901297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b8c7-fbe0-4ad4-8d75-82f8b15e075e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:29.903251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b8c7-fbe0-4ad4-8d75-82f8b15e075e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:29.924491 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1384/2758] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:23:29 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:23:29.928742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5863-cf51-47be-8110-84636fb7cf4e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:29.939632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5863-cf51-47be-8110-84636fb7cf4e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:29.945202 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d73093-2244-4eaf-b13e-5cc8a5cb74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:29.945924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73093-2244-4eaf-b13e-5cc8a5cb74b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.946205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73093-2244-4eaf-b13e-5cc8a5cb74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.946469 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73093-2244-4eaf-b13e-5cc8a5cb74b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.947192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d73093-2244-4eaf-b13e-5cc8a5cb74b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:29.948794 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d73093-2244-4eaf-b13e-5cc8a5cb74b7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:29.960163 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1375/2759] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:29.964243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6b8c7-fbe0-4ad4-8d75-82f8b15e075e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:29.974985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6b8c7-fbe0-4ad4-8d75-82f8b15e075e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:29.980289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5330-a048-42d5-8396-b30109f82978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:29.980946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5330-a048-42d5-8396-b30109f82978 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:29.981232 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5330-a048-42d5-8396-b30109f82978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:29.981506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5330-a048-42d5-8396-b30109f82978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:29.982269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5330-a048-42d5-8396-b30109f82978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:29.983860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5330-a048-42d5-8396-b30109f82978 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:29.994283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1385/2760] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:23:29.998372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d73093-2244-4eaf-b13e-5cc8a5cb74b7 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:30.009068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d73093-2244-4eaf-b13e-5cc8a5cb74b7 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:30.014620 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:30.015610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:30.016024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:30.016191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] PATH_INFO: `/v3/projects/ac4cd16fac46470eb48bb273b12ac6f0/users/9ee5ba617c5f4038930c30773c207a58/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:30.031271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4cd16fac46470eb48bb273b12ac6f0, user_id=9ee5ba617c5f4038930c30773c207a58, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:30.034029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:30.049254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1376/2761] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:23:29 2022] PUT /identity/v3/projects/ac4cd16fac46470eb48bb273b12ac6f0/users/9ee5ba617c5f4038930c30773c207a58/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:23:30.054572 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddcd32-527f-4133-aa02-f5864c7e5b1d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:30.055675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddcd32-527f-4133-aa02-f5864c7e5b1d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:30.055962 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddcd32-527f-4133-aa02-f5864c7e5b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:30.075765 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e6ddcd32-527f-4133-aa02-f5864c7e5b1d None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:30.076974 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6ddcd32-527f-4133-aa02-f5864c7e5b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:30.138581 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1386/2762] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:30.148450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:30.150480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:30.169497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:30.215898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ceaf1-4a33-4dfd-aa6a-7551b222da36 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:30.221885 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:30.222537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:30.222816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:30.223192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:30.233160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:30.234613 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:30.244152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1377/2763] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:30.857501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969322-e3ad-46ac-b9ba-4c27c5fe5060 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:30.857870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969322-e3ad-46ac-b9ba-4c27c5fe5060 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:30.858203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969322-e3ad-46ac-b9ba-4c27c5fe5060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:30.888941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-57969322-e3ad-46ac-b9ba-4c27c5fe5060 None None] MFA Rules not processed for user `9ee5ba617c5f4038930c30773c207a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:30.890309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-57969322-e3ad-46ac-b9ba-4c27c5fe5060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:30.956822 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1387/2764] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:30.967478 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:30.969032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:31.031277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadfbab-7379-4690-aa5c-4584978e2bda service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:31.035843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:31.036505 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:31.036787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:31.037061 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:31.045915 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:31.047513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:31.056673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1378/2765] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:32.443585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b602-ea96-4dfe-98d1-93014d3ba1ed None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:32.444106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b602-ea96-4dfe-98d1-93014d3ba1ed None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:32.444106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98b602-ea96-4dfe-98d1-93014d3ba1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:32.464284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bd98b602-ea96-4dfe-98d1-93014d3ba1ed None None] MFA Rules not processed for user `9ee5ba617c5f4038930c30773c207a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:23:32.465483 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd98b602-ea96-4dfe-98d1-93014d3ba1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:32.472787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1388/2766] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:23:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:23:32.514746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:32.517139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:32.584523 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e686-0389-4660-b101-41332c091c65 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:32.588611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c211cd37d7f49eaa916d332580135c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:32.589195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:32.589484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:32.589759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:32.591711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:32.665756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:32.667229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:32.678412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1379/2767] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:32.884173 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b602-ea96-4dfe-98d1-93014d3ba1ed None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:32.885670 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd98b602-ea96-4dfe-98d1-93014d3ba1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:32.900122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98b602-ea96-4dfe-98d1-93014d3ba1ed None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:32.904174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:32.904826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:32.905104 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:32.905376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:32.907190 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:32.916944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:32.918404 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:32.926560 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1389/2768] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:33.279788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:33.284814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=100 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:33.292567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d57b1-893a-4827-8224-8dae40aa9da6 service glance] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:33.296972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1c108-533e-4d6c-9b7e-7a6f3abfb5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:33.297697 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c108-533e-4d6c-9b7e-7a6f3abfb5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:33.298100 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c108-533e-4d6c-9b7e-7a6f3abfb5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:33.298442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c108-533e-4d6c-9b7e-7a6f3abfb5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:33.300733 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-39f1c108-533e-4d6c-9b7e-7a6f3abfb5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:33.316756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1c108-533e-4d6c-9b7e-7a6f3abfb5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:33.318262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1c108-533e-4d6c-9b7e-7a6f3abfb5c2 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:33.330050 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1380/2769] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:35.770164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:23:35.772747 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:35.794154 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c25d63-4ee8-418f-be53-e794121e4ea8 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:23:35.801147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:23:35.801810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:23:35.802107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:23:35.802380 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:23:35.804424 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:23:35.819106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:23:35.820873 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:23:35.833316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1390/2770] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:23:43.324902 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:23:45.827668 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:11.569643 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe8dc-1ca5-4bc9-b67a-fcbae8e9b039 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:11.570273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe8dc-1ca5-4bc9-b67a-fcbae8e9b039 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:11.570273 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe8dc-1ca5-4bc9-b67a-fcbae8e9b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:11.588143 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-82dfe8dc-1ca5-4bc9-b67a-fcbae8e9b039 None None] MFA Rules not processed for user `4b43fe7da444445fbffb6158d332d99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:24:11.589782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-82dfe8dc-1ca5-4bc9-b67a-fcbae8e9b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:11.645127 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1381/2771] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:24:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:24:12.305009 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:12.307188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:12.379548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9afc32-a244-409b-9693-77ed8157ada8 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:12.384549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:12.385197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:12.385478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:12.385756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:12.387565 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:12.398825 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:12.400444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:12.410537 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1391/2772] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:24:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:24:17.870023 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfe8dc-1ca5-4bc9-b67a-fcbae8e9b039 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:17.886728 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfe8dc-1ca5-4bc9-b67a-fcbae8e9b039 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:17.893734 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:17.894539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:17.894863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:17.895368 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:17.898102 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:17.911389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:17.912982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:17.925582 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1382/2773] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:24:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:24:22.406518 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=32 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:27.921580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=31 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:33.024678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:33.037678 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade91a43-f494-409e-9203-cf2968765b4a service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:33.045036 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:33.045694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:33.045999 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:33.046505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:33.048318 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:33.061425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:33.063067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:33.074348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1392/2774] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:24:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:24:43.070086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:47.557301 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:47.576650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61866cd9-ebb1-4ebf-bb28-d665fd3dac5c service nova] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:47.580450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc081d6-cf63-488f-bd9a-6c3a32ea0c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:47.581095 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc081d6-cf63-488f-bd9a-6c3a32ea0c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:47.581375 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc081d6-cf63-488f-bd9a-6c3a32ea0c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:47.581650 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc081d6-cf63-488f-bd9a-6c3a32ea0c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:47.583632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4fc081d6-cf63-488f-bd9a-6c3a32ea0c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:47.617925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc081d6-cf63-488f-bd9a-6c3a32ea0c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:47.619367 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc081d6-cf63-488f-bd9a-6c3a32ea0c72 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:47.629195 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1383/2775] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:24:50.723852 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:50.725485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:50.779618 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fb9fc-d20f-4076-8558-f0c808561b8e service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:50.785199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:50.785901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:50.786184 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:50.786965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:50.788378 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:50.801624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:50.803441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:50.817326 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1393/2776] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:24:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:24:52.086743 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4c6a-a733-498e-8e88-4844c3456a9b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:52.087277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4c6a-a733-498e-8e88-4844c3456a9b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:52.087387 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4c6a-a733-498e-8e88-4844c3456a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:52.106761 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-230f4c6a-a733-498e-8e88-4844c3456a9b None None] MFA Rules not processed for user `9ee5ba617c5f4038930c30773c207a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:24:52.108063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-230f4c6a-a733-498e-8e88-4844c3456a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:52.116042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1384/2777] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:24:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:24:52.755313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:52.766100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb005dd8-c42f-4876-8053-4d78d49947d3 service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:52.770449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:52.771556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:52.772061 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:52.772523 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:52.775412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:52.788057 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:52.789810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:52.800345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1394/2778] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:24:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:24:54.260679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f4c6a-a733-498e-8e88-4844c3456a9b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:54.294982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f4c6a-a733-498e-8e88-4844c3456a9b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:54.310453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:54.311261 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:54.311621 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:54.312121 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:54.318315 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:54.345501 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:54.347746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:54.415695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf5b9a-ef45-4abe-a8a0-09f5e480bebb service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:54.416351 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:54.418157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:54.423188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:54.425223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:54.425563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:54.425905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] PATH_INFO: `/v3/users/d21524f4232648ebaed76e1d7d5daf5f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:54.427224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21524f4232648ebaed76e1d7d5daf5f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:54.429379 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:54.430821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1385/2779] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:24:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:24:54.483802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21524f4232648ebaed76e1d7d5daf5f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.484449 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21524f4232648ebaed76e1d7d5daf5f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.494285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21524f4232648ebaed76e1d7d5daf5f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.502138 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21524f4232648ebaed76e1d7d5daf5f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.515788 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21524f4232648ebaed76e1d7d5daf5f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.522192 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1395/2780] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:24:54 2022] DELETE /identity/v3/users/d21524f4232648ebaed76e1d7d5daf5f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:24:54.712611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:54.725150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b351-40a8-41d8-8f35-adaf957716a8 service placement] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:54.787284 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:54.788166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:54.788448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:54.788722 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] PATH_INFO: `/v3/projects/e393091e3c2d42e79e9f2ec80d471faf` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:54.789950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e393091e3c2d42e79e9f2ec80d471faf)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:54.791921 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:54.847679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e393091e3c2d42e79e9f2ec80d471faf', 'request_id': 'req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.853107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e393091e3c2d42e79e9f2ec80d471faf', 'request_id': 'req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.860939 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e393091e3c2d42e79e9f2ec80d471faf', 'request_id': 'req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.875502 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] The token cache is being invalidate because project e393091e3c2d42e79e9f2ec80d471faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:24:54.875788 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.876409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:54.878029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1386/2781] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:24:54 2022] DELETE /identity/v3/projects/e393091e3c2d42e79e9f2ec80d471faf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:24:54.882312 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:54.883857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:54.897647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835456-72bd-45a5-a066-e087400e1d2a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:54.957011 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:54.957943 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:54.958221 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:54.958506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] PATH_INFO: `/v3/users/dddc0993c84f446f95d2371eab6c6dba` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:54.959787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddc0993c84f446f95d2371eab6c6dba)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:54.961755 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:54.967384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:55.013591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddc0993c84f446f95d2371eab6c6dba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.014309 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddc0993c84f446f95d2371eab6c6dba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.024206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddc0993c84f446f95d2371eab6c6dba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.031860 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddc0993c84f446f95d2371eab6c6dba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.043709 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddc0993c84f446f95d2371eab6c6dba'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.049748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1396/2782] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:24:54 2022] DELETE /identity/v3/users/dddc0993c84f446f95d2371eab6c6dba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:24:55.254431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:24:55.256275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:24:55.285434 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e90ec-95dd-4ee7-9763-d98e8cdc5cd8 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:24:55.290665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:24:55.359869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:24:55.360975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:24:55.361417 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:24:55.361880 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] PATH_INFO: `/v3/projects/71ad97c2962e4f4291d1f5f31af2ede5` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:24:55.363235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ad97c2962e4f4291d1f5f31af2ede5)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:24:55.365347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:24:55.426277 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ad97c2962e4f4291d1f5f31af2ede5', 'request_id': 'req-d935488b-ce22-489f-a209-1b0980f52e9a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.434834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ad97c2962e4f4291d1f5f31af2ede5', 'request_id': 'req-d935488b-ce22-489f-a209-1b0980f52e9a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.443410 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ad97c2962e4f4291d1f5f31af2ede5', 'request_id': 'req-d935488b-ce22-489f-a209-1b0980f52e9a'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.462749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] The token cache is being invalidate because project 71ad97c2962e4f4291d1f5f31af2ede5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:24:55.463092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.463746 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:24:55.466492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1387/2783] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:24:55 2022] DELETE /identity/v3/projects/71ad97c2962e4f4291d1f5f31af2ede5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:25:05.046239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:05.458176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:32.168030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:25:32.169743 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:25:32.271038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818ce98-3848-4395-a46f-87983b0f97e0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:25:32.336364 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:25:32.336761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:25:32.337705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:25:32.338035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:25:32.340167 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:25:32.352278 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:25:32.353945 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:25:32.364155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1397/2784] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:25:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:25:42.359688 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=67 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:25:59.123278 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:25:59.125693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:25:59.242098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935488b-ce22-489f-a209-1b0980f52e9a admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:25:59.247168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:25:59.248168 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:25:59.248503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:25:59.248795 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] PATH_INFO: `/v3/users/9ee5ba617c5f4038930c30773c207a58` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:25:59.250235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee5ba617c5f4038930c30773c207a58)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:25:59.252158 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:25:59.313642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee5ba617c5f4038930c30773c207a58'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.325339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee5ba617c5f4038930c30773c207a58'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.342137 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee5ba617c5f4038930c30773c207a58'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.351372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee5ba617c5f4038930c30773c207a58'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.352300 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee5ba617c5f4038930c30773c207a58'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.359146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1388/2785] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:25:59 2022] DELETE /identity/v3/users/9ee5ba617c5f4038930c30773c207a58 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 17:25:59.575197 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:25:59.587028 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559afcb5-f88f-404c-9fa4-fd1069946b48 service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:25:59.675353 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:25:59.676492 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:25:59.676773 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:25:59.677739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] PATH_INFO: `/v3/projects/ac4cd16fac46470eb48bb273b12ac6f0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:25:59.679371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4cd16fac46470eb48bb273b12ac6f0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:25:59.681285 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:25:59.745195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4cd16fac46470eb48bb273b12ac6f0', 'request_id': 'req-070b96a2-84db-40f3-be97-13a86a2dbf4f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.751744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4cd16fac46470eb48bb273b12ac6f0', 'request_id': 'req-070b96a2-84db-40f3-be97-13a86a2dbf4f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.758632 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4cd16fac46470eb48bb273b12ac6f0', 'request_id': 'req-070b96a2-84db-40f3-be97-13a86a2dbf4f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.779519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] The token cache is being invalidate because project ac4cd16fac46470eb48bb273b12ac6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:25:59.779954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.781110 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-070b96a2-84db-40f3-be97-13a86a2dbf4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:25:59.783750 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1398/2786] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:25:59 2022] DELETE /identity/v3/projects/ac4cd16fac46470eb48bb273b12ac6f0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:26:09.355330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:09.774224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:19.350871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:26:19.352950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:26:19.466614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e6c88-0367-4220-9403-491b5f49a464 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:26:19.537561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:26:19.538226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:26:19.538527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:26:19.538806 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:26:19.540773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:26:19.602408 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:26:19.603945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:26:19.613851 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1389/2787] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:26:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:26:29.609235 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=96 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:38.274329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0316459-0f22-4a20-9d45-9aaa5d9453e2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:26:38.274864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0316459-0f22-4a20-9d45-9aaa5d9453e2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:26:38.274964 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0316459-0f22-4a20-9d45-9aaa5d9453e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:26:38.344696 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a0316459-0f22-4a20-9d45-9aaa5d9453e2 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:26:38.346584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a0316459-0f22-4a20-9d45-9aaa5d9453e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:26:38.416941 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1399/2788] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:26:38.470534 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:26:38.472002 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:26:38.571413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8881f-5e00-4eae-a769-52a88bcb8ae6 service nova] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:26:38.576503 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b3de-0f67-4259-8f59-108ffd127cc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:26:38.577150 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b3de-0f67-4259-8f59-108ffd127cc1 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:26:38.577428 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b3de-0f67-4259-8f59-108ffd127cc1 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:26:38.577700 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b3de-0f67-4259-8f59-108ffd127cc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:26:38.586021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267b3de-0f67-4259-8f59-108ffd127cc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:26:38.589262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267b3de-0f67-4259-8f59-108ffd127cc1 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:26:38.597269 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1390/2789] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:26:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:26:48.413510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=44 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:48.594500 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=41 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:26:57.220720 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c603-f8b2-4888-9f37-3cc9196b1e4a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:26:57.221224 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c603-f8b2-4888-9f37-3cc9196b1e4a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:26:57.221336 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9c603-f8b2-4888-9f37-3cc9196b1e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:26:57.240558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d8d9c603-f8b2-4888-9f37-3cc9196b1e4a None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:26:57.241777 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d8d9c603-f8b2-4888-9f37-3cc9196b1e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:26:57.249832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1400/2790] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jun 23 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:26:57.264937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b3de-0f67-4259-8f59-108ffd127cc1 service swift] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:26:57.276416 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b3de-0f67-4259-8f59-108ffd127cc1 service swift] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:26:57.283062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8d3c6-9aa6-48bb-9779-62fd45e819b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:26:57.283755 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8d3c6-9aa6-48bb-9779-62fd45e819b9 service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:26:57.284036 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8d3c6-9aa6-48bb-9779-62fd45e819b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:26:57.284306 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8d3c6-9aa6-48bb-9779-62fd45e819b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:26:57.294112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8d3c6-9aa6-48bb-9779-62fd45e819b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:26:57.295702 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8d3c6-9aa6-48bb-9779-62fd45e819b9 service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:26:57.305781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1391/2791] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:26:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:27:07.235155 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:27:07.301004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=6 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:27:16.352746 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693fb65-fce3-45a4-9d21-b1999b31d7f9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:27:16.353244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693fb65-fce3-45a4-9d21-b1999b31d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:27:16.353362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693fb65-fce3-45a4-9d21-b1999b31d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:27:16.372811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0693fb65-fce3-45a4-9d21-b1999b31d7f9 None None] MFA Rules not processed for user `faa0343291164cbc9f9ca0aa754ecad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:27:16.374062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0693fb65-fce3-45a4-9d21-b1999b31d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:27:16.382772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1401/2792] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jun 23 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:27:16.395394 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8d3c6-9aa6-48bb-9779-62fd45e819b9 service swift] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:27:16.407446 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8d3c6-9aa6-48bb-9779-62fd45e819b9 service swift] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:27:16.413075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08ffc7cdb0d54083bbedaa3e7441e099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:27:16.413853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:27:16.414206 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:27:16.414551 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:27:16.423642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:27:16.425336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:27:16.434293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1392/2793] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jun 23 17:27:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 17:27:26.367433 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:27:26.430982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=6 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:19.964630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693fb65-fce3-45a4-9d21-b1999b31d7f9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:19.966354 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0693fb65-fce3-45a4-9d21-b1999b31d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:20.045922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693fb65-fce3-45a4-9d21-b1999b31d7f9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:20.050215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:20.050874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:20.051156 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:20.051429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:20.053662 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:20.119313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:20.120761 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:20.131387 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1402/2794] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:28:23.333477 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:23.335029 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:23.350064 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772390-49e1-4d27-beb4-e5dd4cc8bf8b service swift] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:23.354587 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:23.355530 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:23.355805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:23.356065 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] PATH_INFO: `/v3/users/4b43fe7da444445fbffb6158d332d99d` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:23.357262 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b43fe7da444445fbffb6158d332d99d)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:23.359207 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:23.413563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b43fe7da444445fbffb6158d332d99d'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.423979 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b43fe7da444445fbffb6158d332d99d'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.438799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b43fe7da444445fbffb6158d332d99d'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.446497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b43fe7da444445fbffb6158d332d99d'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.447165 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-431c5abc-ba3d-4858-8af3-7699bcfc84b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b43fe7da444445fbffb6158d332d99d'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.453151 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1393/2795] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:28:23 2022] DELETE /identity/v3/users/4b43fe7da444445fbffb6158d332d99d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:28:23.632496 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:23.642370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d5584-30fc-40f0-ba4e-227873ffc256 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:23.701590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:23.702767 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:23.704596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:23.704596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] PATH_INFO: `/v3/projects/e2d73f7bfc184cacb49809a89563b585` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:23.706879 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d73f7bfc184cacb49809a89563b585)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:23.708932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:23.749878 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:23.762740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d73f7bfc184cacb49809a89563b585', 'request_id': 'req-e0840468-e010-4c60-9ec4-7a2aab1391e0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.768026 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d73f7bfc184cacb49809a89563b585', 'request_id': 'req-e0840468-e010-4c60-9ec4-7a2aab1391e0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.774215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d73f7bfc184cacb49809a89563b585', 'request_id': 'req-e0840468-e010-4c60-9ec4-7a2aab1391e0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.788188 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] The token cache is being invalidate because project e2d73f7bfc184cacb49809a89563b585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:28:23.788532 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.789145 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0840468-e010-4c60-9ec4-7a2aab1391e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:28:23.790756 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1403/2796] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:28:23 2022] DELETE /identity/v3/projects/e2d73f7bfc184cacb49809a89563b585 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:28:23.795930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbfb5b-f87f-4702-a095-5981fd07dd67 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:23.796217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbfb5b-f87f-4702-a095-5981fd07dd67 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:23.796492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbfb5b-f87f-4702-a095-5981fd07dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:23.855107 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-b8cbfb5b-f87f-4702-a095-5981fd07dd67 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:28:23.856327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-b8cbfb5b-f87f-4702-a095-5981fd07dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:23.920769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1394/2797] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:28:23.928384 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c655b-3c9d-4f53-a3c0-2bfe8ce8bae8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:23.928751 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c655b-3c9d-4f53-a3c0-2bfe8ce8bae8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:23.929098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c655b-3c9d-4f53-a3c0-2bfe8ce8bae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:23.948622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c33c655b-3c9d-4f53-a3c0-2bfe8ce8bae8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:28:23.949864 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c33c655b-3c9d-4f53-a3c0-2bfe8ce8bae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:23.958240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1404/2798] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:28:23.962610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbfb5b-f87f-4702-a095-5981fd07dd67 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:23.972474 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbfb5b-f87f-4702-a095-5981fd07dd67 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:23.978022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:23.978692 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:23.979108 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:23.979449 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:23.980283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:28:23.980657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:23.982540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:23.995070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1395/2799] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 17:28:23.999568 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c655b-3c9d-4f53-a3c0-2bfe8ce8bae8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:24.009202 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c655b-3c9d-4f53-a3c0-2bfe8ce8bae8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:24.014198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768746-4d31-4433-85c1-c1965228704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:24.014806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768746-4d31-4433-85c1-c1965228704d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:24.015086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768746-4d31-4433-85c1-c1965228704d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:24.015359 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768746-4d31-4433-85c1-c1965228704d admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:24.016067 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a768746-4d31-4433-85c1-c1965228704d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:24.018052 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a768746-4d31-4433-85c1-c1965228704d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:24.046513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1405/2800] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:28:23 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:28:24.052297 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:24.063292 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dcf06-64ca-4e27-b98d-3cf395b54929 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:24.090015 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:24.121994 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19945910-3ed4-4d89-b08d-801e8aedd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:24.122667 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19945910-3ed4-4d89-b08d-801e8aedd55f admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:24.122945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19945910-3ed4-4d89-b08d-801e8aedd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:24.123219 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19945910-3ed4-4d89-b08d-801e8aedd55f admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:24.123906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19945910-3ed4-4d89-b08d-801e8aedd55f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:24.125832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19945910-3ed4-4d89-b08d-801e8aedd55f admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:24.146581 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1396/2801] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:28:24 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:28:24.150716 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768746-4d31-4433-85c1-c1965228704d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:24.161561 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768746-4d31-4433-85c1-c1965228704d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:24.166881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da62c-e194-4d4d-b045-0ac127aa0692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:24.167551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da62c-e194-4d4d-b045-0ac127aa0692 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:24.167832 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da62c-e194-4d4d-b045-0ac127aa0692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:24.168109 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da62c-e194-4d4d-b045-0ac127aa0692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:24.168851 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4da62c-e194-4d4d-b045-0ac127aa0692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:24.170511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4da62c-e194-4d4d-b045-0ac127aa0692 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:24.183552 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1406/2802] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:28:24.189647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19945910-3ed4-4d89-b08d-801e8aedd55f admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:24.206616 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19945910-3ed4-4d89-b08d-801e8aedd55f admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:24.212905 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f1419-ba5b-4a35-b807-ec7b93802e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:24.213572 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1419-ba5b-4a35-b807-ec7b93802e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:24.213881 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1419-ba5b-4a35-b807-ec7b93802e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:24.214157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f1419-ba5b-4a35-b807-ec7b93802e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:24.214888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f1419-ba5b-4a35-b807-ec7b93802e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:24.216483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f1419-ba5b-4a35-b807-ec7b93802e44 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:24.227176 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1397/2803] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:28:24.231546 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da62c-e194-4d4d-b045-0ac127aa0692 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:24.241827 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da62c-e194-4d4d-b045-0ac127aa0692 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:24.246741 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:24.247622 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:24.247893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:24.248164 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] PATH_INFO: `/v3/projects/1bba540f52204efcb203231d7d780810/users/2fd5f4bd4834436bace14bcca9768658/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:24.263217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bba540f52204efcb203231d7d780810, user_id=2fd5f4bd4834436bace14bcca9768658, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:24.265944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:24.282478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1407/2804] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:28:24 2022] PUT /identity/v3/projects/1bba540f52204efcb203231d7d780810/users/2fd5f4bd4834436bace14bcca9768658/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:28:24.288174 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2217-dbe3-4c4b-9d6a-2a848b6ca531 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:24.288465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2217-dbe3-4c4b-9d6a-2a848b6ca531 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:24.288742 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2217-dbe3-4c4b-9d6a-2a848b6ca531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:24.307482 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d41d2217-dbe3-4c4b-9d6a-2a848b6ca531 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:28:24.308745 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d41d2217-dbe3-4c4b-9d6a-2a848b6ca531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:24.370337 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1398/2805] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:28:24.380128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:24.381914 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:24.445631 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404be6-52f7-469d-874b-1133e6e6cf83 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:24.450444 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:24.451089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:24.451977 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:24.452275 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:24.463023 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:24.464461 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:24.474488 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1408/2806] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:28:28.386698 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798afa-fccc-473e-86ad-db36d75469a7 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:28.387155 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798afa-fccc-473e-86ad-db36d75469a7 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:28.387257 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798afa-fccc-473e-86ad-db36d75469a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:28.415625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-73798afa-fccc-473e-86ad-db36d75469a7 None None] MFA Rules not processed for user `2fd5f4bd4834436bace14bcca9768658`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:28:28.416848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-73798afa-fccc-473e-86ad-db36d75469a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:28.494955 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1399/2807] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:28:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:28:28.502489 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:28.504334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:28.586071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:28.603935 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbee494-694d-4f7d-a96f-6446410c384a service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:28.615927 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:28.616529 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:28.616811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:28.617090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:28.625891 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:28.627613 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:28.638191 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1409/2808] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:28:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:28:29.988917 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0548-f2f3-4443-9fcb-2a622f11e15d None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:29.989574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0548-f2f3-4443-9fcb-2a622f11e15d None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:29.989574 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0548-f2f3-4443-9fcb-2a622f11e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:30.009987 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-259a0548-f2f3-4443-9fcb-2a622f11e15d None None] MFA Rules not processed for user `2fd5f4bd4834436bace14bcca9768658`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:28:30.011291 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-259a0548-f2f3-4443-9fcb-2a622f11e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:30.019875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1400/2809] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:28:32.574861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:32.576453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:32.590174 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab39d9d-0a08-48f1-a742-edd868639488 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:32.594195 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:32.594861 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:32.595148 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:32.595425 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:32.597321 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:32.608792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:32.610292 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:32.619904 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1410/2810] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:28:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:28:32.989170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a0548-f2f3-4443-9fcb-2a622f11e15d None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:33.000146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a0548-f2f3-4443-9fcb-2a622f11e15d None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:33.007010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:33.007866 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:33.008713 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:33.009022 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:33.011811 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:33.028665 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:33.030453 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:33.042906 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1401/2811] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:28:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:28:35.419103 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:35.428933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3fb7d-7410-4658-93c8-40a448e68094 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:35.433100 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:35.433744 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:35.434056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:35.434329 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:35.436641 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:35.451367 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:35.452812 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:35.464259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1411/2812] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:28:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:28:42.834811 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:28:42.836386 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:42.851067 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b9f2c-41de-4ed5-899c-447eed22fd75 service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:28:42.857520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc263fc0-5c15-4c3e-94dc-8f99913d5c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:28:42.858275 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc263fc0-5c15-4c3e-94dc-8f99913d5c65 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:28:42.858583 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc263fc0-5c15-4c3e-94dc-8f99913d5c65 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:28:42.858904 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc263fc0-5c15-4c3e-94dc-8f99913d5c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:28:42.860911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-fc263fc0-5c15-4c3e-94dc-8f99913d5c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:28:42.874087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc263fc0-5c15-4c3e-94dc-8f99913d5c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:28:42.875716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc263fc0-5c15-4c3e-94dc-8f99913d5c65 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:28:42.886514 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1402/2813] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:28:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:28:45.459322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=19 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:28:52.881990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:31:15.864019 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:31:15.865684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:31:15.939478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4f245-cbd1-410a-88d6-1ecbcccf68de service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:31:15.945437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:31:15.946070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:31:15.946349 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:31:15.946625 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:31:15.948591 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:31:15.961262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:31:15.962862 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:31:15.973198 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1412/2814] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:31:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:31:25.968912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=32 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:38.172542 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc043de-c7e4-4621-acb1-61a6d9515d24 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:32:38.173099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc043de-c7e4-4621-acb1-61a6d9515d24 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:32:38.173099 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc043de-c7e4-4621-acb1-61a6d9515d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:32:38.191922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-dfc043de-c7e4-4621-acb1-61a6d9515d24 None None] MFA Rules not processed for user `2fd5f4bd4834436bace14bcca9768658`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:32:38.193133 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-dfc043de-c7e4-4621-acb1-61a6d9515d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:32:38.201139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1403/2815] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:32:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:32:38.505657 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:32:38.515378 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2a93e-b5dd-47f9-820d-67da3edd2d7e service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:32:38.519239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:32:38.519876 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:32:38.520160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:32:38.520439 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:32:38.522283 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:32:38.531920 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:32:38.533344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:32:38.541331 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1413/2816] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:32:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:32:38.856012 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc043de-c7e4-4621-acb1-61a6d9515d24 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:32:38.857924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-dfc043de-c7e4-4621-acb1-61a6d9515d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:32:38.873958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc043de-c7e4-4621-acb1-61a6d9515d24 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:32:38.879663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:32:38.880330 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:32:38.880614 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:32:38.880891 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:32:38.882924 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:32:38.894870 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:32:38.896510 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:32:38.906691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1404/2817] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:32:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:32:47.830063 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:32:47.845113 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59d073-8696-4033-bb30-2808b5743be6 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:32:47.851534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:32:47.852187 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:32:47.852465 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:32:47.852740 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:32:47.854630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:32:47.867033 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:32:47.868909 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:32:47.880472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1414/2818] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:32:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:32:48.902299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=9 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:32:57.875701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=12 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:06.935101 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:06.949341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1aba1-66f5-4624-96b9-a6f7876c93f9 service placement] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:06.955792 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448990f1-b973-4de6-90cd-4e03d778f6a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:06.956432 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448990f1-b973-4de6-90cd-4e03d778f6a7 service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:06.956715 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448990f1-b973-4de6-90cd-4e03d778f6a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:06.956992 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448990f1-b973-4de6-90cd-4e03d778f6a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:06.965183 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448990f1-b973-4de6-90cd-4e03d778f6a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:06.966819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448990f1-b973-4de6-90cd-4e03d778f6a7 service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:06.976250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1405/2819] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:08.452107 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:08.453809 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:08.545590 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7bc89-8f66-4107-ae21-abb258eb2bf6 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:08.550988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca1602-6ad1-4440-91cd-50b13d5d1f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:08.551947 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca1602-6ad1-4440-91cd-50b13d5d1f69 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:08.552239 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca1602-6ad1-4440-91cd-50b13d5d1f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:08.552521 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca1602-6ad1-4440-91cd-50b13d5d1f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:08.564381 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca1602-6ad1-4440-91cd-50b13d5d1f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:08.565971 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca1602-6ad1-4440-91cd-50b13d5d1f69 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:08.578295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1415/2820] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:16.972303 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=6 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:17.890864 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448990f1-b973-4de6-90cd-4e03d778f6a7 service nova] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:17.906975 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448990f1-b973-4de6-90cd-4e03d778f6a7 service nova] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:17.913853 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00cc84-84d5-48f2-ba6c-6274d3789929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:17.914762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00cc84-84d5-48f2-ba6c-6274d3789929 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:17.915053 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00cc84-84d5-48f2-ba6c-6274d3789929 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:17.915324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00cc84-84d5-48f2-ba6c-6274d3789929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:17.929448 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00cc84-84d5-48f2-ba6c-6274d3789929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:17.930929 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00cc84-84d5-48f2-ba6c-6274d3789929 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:17.942627 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1406/2821] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:18.572604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=35 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:25.031455 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca1602-6ad1-4440-91cd-50b13d5d1f69 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:25.043806 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca1602-6ad1-4440-91cd-50b13d5d1f69 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:25.047596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c5bb3-06e7-4e9a-8072-4ab7e351a317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:25.048251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5bb3-06e7-4e9a-8072-4ab7e351a317 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:25.048533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5bb3-06e7-4e9a-8072-4ab7e351a317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:25.048810 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5bb3-06e7-4e9a-8072-4ab7e351a317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:25.057647 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c5bb3-06e7-4e9a-8072-4ab7e351a317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:25.059126 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c5bb3-06e7-4e9a-8072-4ab7e351a317 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:25.068416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1416/2822] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:27.937783 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=6 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:33.316834 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00cc84-84d5-48f2-ba6c-6274d3789929 service cinder] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:33.331525 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00cc84-84d5-48f2-ba6c-6274d3789929 service cinder] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:33.337907 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae738b1-bfd4-4c34-82b0-2c126a8936ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10b3274005534830b0768b122769dd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:33.338573 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae738b1-bfd4-4c34-82b0-2c126a8936ad service nova] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:33.338857 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae738b1-bfd4-4c34-82b0-2c126a8936ad service nova] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:33.339132 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae738b1-bfd4-4c34-82b0-2c126a8936ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:33.349827 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae738b1-bfd4-4c34-82b0-2c126a8936ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:33.351639 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae738b1-bfd4-4c34-82b0-2c126a8936ad service nova] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:33.364828 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1407/2823] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 17:34:35.064203 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:39.096599 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c5bb3-06e7-4e9a-8072-4ab7e351a317 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:39.105837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c5bb3-06e7-4e9a-8072-4ab7e351a317 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:39.109785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fd0b8-1f49-4104-9e2b-bc0f5e69d732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:39.110463 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd0b8-1f49-4104-9e2b-bc0f5e69d732 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:39.110748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd0b8-1f49-4104-9e2b-bc0f5e69d732 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:39.111016 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd0b8-1f49-4104-9e2b-bc0f5e69d732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:39.121450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fd0b8-1f49-4104-9e2b-bc0f5e69d732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:39.122973 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fd0b8-1f49-4104-9e2b-bc0f5e69d732 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:39.133368 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1417/2824] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:42.033720 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae738b1-bfd4-4c34-82b0-2c126a8936ad service nova] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.046226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae738b1-bfd4-4c34-82b0-2c126a8936ad service nova] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:42.051561 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:42.052248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.052779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.053090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.055798 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:42.068753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:42.070537 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:42.081972 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1408/2825] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:42.104248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fd0b8-1f49-4104-9e2b-bc0f5e69d732 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.119244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fd0b8-1f49-4104-9e2b-bc0f5e69d732 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:42.124585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:42.125478 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.125785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.126086 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] PATH_INFO: `/v3/users/2fd5f4bd4834436bace14bcca9768658` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.127376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd5f4bd4834436bace14bcca9768658)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:42.129303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:42.179753 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd5f4bd4834436bace14bcca9768658'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.180416 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd5f4bd4834436bace14bcca9768658'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.189542 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd5f4bd4834436bace14bcca9768658'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.197545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd5f4bd4834436bace14bcca9768658'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.212281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9fb555b4-f594-487d-b489-44bee05de145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd5f4bd4834436bace14bcca9768658'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.218667 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1418/2826] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:34:42 2022] DELETE /identity/v3/users/2fd5f4bd4834436bace14bcca9768658 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:42.401443 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.412628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e698a6-0f37-4932-a44a-3d678b328a2d service placement] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:42.473327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:42.474250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.474526 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.474799 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] PATH_INFO: `/v3/projects/1bba540f52204efcb203231d7d780810` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.475966 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bba540f52204efcb203231d7d780810)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:42.477985 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:42.526760 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bba540f52204efcb203231d7d780810', 'request_id': 'req-41dfc4ec-54ae-4828-9312-2797439694ce'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.532071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bba540f52204efcb203231d7d780810', 'request_id': 'req-41dfc4ec-54ae-4828-9312-2797439694ce'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.538069 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bba540f52204efcb203231d7d780810', 'request_id': 'req-41dfc4ec-54ae-4828-9312-2797439694ce'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.551251 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] The token cache is being invalidate because project 1bba540f52204efcb203231d7d780810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:34:42.551530 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.552130 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-41dfc4ec-54ae-4828-9312-2797439694ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:42.553691 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1409/2827] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:34:42 2022] DELETE /identity/v3/projects/1bba540f52204efcb203231d7d780810 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:42.559295 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49548e-7319-4b27-8ce1-c90c830d0a0e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.559585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49548e-7319-4b27-8ce1-c90c830d0a0e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.559863 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49548e-7319-4b27-8ce1-c90c830d0a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.580411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5b49548e-7319-4b27-8ce1-c90c830d0a0e None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:34:42.582281 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5b49548e-7319-4b27-8ce1-c90c830d0a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:42.656963 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1419/2828] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:34:42.665647 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02d32-4218-458f-8919-8922dd6a033b None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.666000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02d32-4218-458f-8919-8922dd6a033b None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.666279 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02d32-4218-458f-8919-8922dd6a033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.687673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-35e02d32-4218-458f-8919-8922dd6a033b None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:34:42.689173 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-35e02d32-4218-458f-8919-8922dd6a033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:42.698149 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1410/2829] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:34:42.702604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49548e-7319-4b27-8ce1-c90c830d0a0e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.712611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49548e-7319-4b27-8ce1-c90c830d0a0e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:42.718377 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:42.719038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.719314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.719585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.720348 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:34:42.720654 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:42.722308 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:42.734913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1420/2830] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:34:42.739124 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e02d32-4218-458f-8919-8922dd6a033b None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.748670 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e02d32-4218-458f-8919-8922dd6a033b None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:42.753895 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eb80a-1fc8-405a-b6e2-842226b08e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:42.754539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb80a-1fc8-405a-b6e2-842226b08e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.754818 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb80a-1fc8-405a-b6e2-842226b08e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.755090 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb80a-1fc8-405a-b6e2-842226b08e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.755779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb80a-1fc8-405a-b6e2-842226b08e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:42.757679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb80a-1fc8-405a-b6e2-842226b08e54 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:42.807289 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1411/2831] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:34:42 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:34:42.811446 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.822598 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7a577-6249-4a36-b7b9-502fc983ca6e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:42.869248 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:42.886603 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3211d1f-c085-417f-8f66-223b42c67112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:42.887282 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211d1f-c085-417f-8f66-223b42c67112 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.887558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211d1f-c085-417f-8f66-223b42c67112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.887839 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211d1f-c085-417f-8f66-223b42c67112 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.888545 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3211d1f-c085-417f-8f66-223b42c67112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:42.890485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3211d1f-c085-417f-8f66-223b42c67112 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:42.914343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1421/2832] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:34:42 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:34:42.918759 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eb80a-1fc8-405a-b6e2-842226b08e54 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.929341 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eb80a-1fc8-405a-b6e2-842226b08e54 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:42.934901 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51163e2-a92c-4d46-a39e-dfe932dbca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:42.935632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51163e2-a92c-4d46-a39e-dfe932dbca60 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.935942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51163e2-a92c-4d46-a39e-dfe932dbca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.936191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51163e2-a92c-4d46-a39e-dfe932dbca60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.937268 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51163e2-a92c-4d46-a39e-dfe932dbca60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:42.938925 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51163e2-a92c-4d46-a39e-dfe932dbca60 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:42.949629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1412/2833] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:34:42.953885 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3211d1f-c085-417f-8f66-223b42c67112 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.964316 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3211d1f-c085-417f-8f66-223b42c67112 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:42.969334 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421759d-e8dd-49ff-82d9-47cab9609735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:42.970008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421759d-e8dd-49ff-82d9-47cab9609735 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:42.970286 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421759d-e8dd-49ff-82d9-47cab9609735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:42.970559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421759d-e8dd-49ff-82d9-47cab9609735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:42.971303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421759d-e8dd-49ff-82d9-47cab9609735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:42.972899 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421759d-e8dd-49ff-82d9-47cab9609735 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:42.983700 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1422/2834] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:34:42.987887 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51163e2-a92c-4d46-a39e-dfe932dbca60 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:42.998454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51163e2-a92c-4d46-a39e-dfe932dbca60 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:43.003227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c2abe-23db-421e-af3f-3c7d02bb97fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:43.004112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c2abe-23db-421e-af3f-3c7d02bb97fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.004397 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c2abe-23db-421e-af3f-3c7d02bb97fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.004674 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c2abe-23db-421e-af3f-3c7d02bb97fe admin admin] PATH_INFO: `/v3/projects/94d6759018f64f7aa81d7b3c89cce2bb/users/474ec6e60b3d479c8fd1cb0252f5b431/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.017227 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:43.020850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c2abe-23db-421e-af3f-3c7d02bb97fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d6759018f64f7aa81d7b3c89cce2bb, user_id=474ec6e60b3d479c8fd1cb0252f5b431, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:43.023787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c2abe-23db-421e-af3f-3c7d02bb97fe admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:43.042423 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1413/2835] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:34:42 2022] PUT /identity/v3/projects/94d6759018f64f7aa81d7b3c89cce2bb/users/474ec6e60b3d479c8fd1cb0252f5b431/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:43.052925 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622aec-430d-4c3c-b526-843fa11977a1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.053204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622aec-430d-4c3c-b526-843fa11977a1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.053476 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622aec-430d-4c3c-b526-843fa11977a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.082815 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-45622aec-430d-4c3c-b526-843fa11977a1 None None] MFA Rules not processed for user `474ec6e60b3d479c8fd1cb0252f5b431`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:34:43.083944 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-45622aec-430d-4c3c-b526-843fa11977a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:43.159870 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1423/2836] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:34:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:34:43.164736 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c2abe-23db-421e-af3f-3c7d02bb97fe admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:43.238263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c2abe-23db-421e-af3f-3c7d02bb97fe admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:43.246796 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dca0e-47d5-453b-aafd-42e19f1cacfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:43.247462 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dca0e-47d5-453b-aafd-42e19f1cacfa admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.247748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dca0e-47d5-453b-aafd-42e19f1cacfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.248025 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dca0e-47d5-453b-aafd-42e19f1cacfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.248724 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dca0e-47d5-453b-aafd-42e19f1cacfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:43.250944 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dca0e-47d5-453b-aafd-42e19f1cacfa admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:43.278832 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1414/2837] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:34:43 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:34:43.283088 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622aec-430d-4c3c-b526-843fa11977a1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:43.294118 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622aec-430d-4c3c-b526-843fa11977a1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:43.353954 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b311d-d82e-4455-b00a-1631a2fda1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:43.354659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b311d-d82e-4455-b00a-1631a2fda1af admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.354985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b311d-d82e-4455-b00a-1631a2fda1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.355193 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b311d-d82e-4455-b00a-1631a2fda1af admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.355924 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b311d-d82e-4455-b00a-1631a2fda1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:43.357874 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b311d-d82e-4455-b00a-1631a2fda1af admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:43.378868 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1424/2838] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:34:43 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 17:34:43.383092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dca0e-47d5-453b-aafd-42e19f1cacfa admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:43.394229 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dca0e-47d5-453b-aafd-42e19f1cacfa admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:43.399886 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66942c96-7e05-4462-b089-34a9101991dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:43.400527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66942c96-7e05-4462-b089-34a9101991dc admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.400842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66942c96-7e05-4462-b089-34a9101991dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.401092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66942c96-7e05-4462-b089-34a9101991dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.402117 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66942c96-7e05-4462-b089-34a9101991dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:43.403718 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66942c96-7e05-4462-b089-34a9101991dc admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:43.414787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1415/2839] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:34:43.419905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b311d-d82e-4455-b00a-1631a2fda1af admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:43.435699 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b311d-d82e-4455-b00a-1631a2fda1af admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:43.443218 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefab63-517d-4c7f-aa8d-c929a0bce454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:43.444510 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefab63-517d-4c7f-aa8d-c929a0bce454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.444866 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefab63-517d-4c7f-aa8d-c929a0bce454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.445276 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefab63-517d-4c7f-aa8d-c929a0bce454 admin admin] PATH_INFO: `/v3/projects/8d872307ee5443fc96be05582e55fbe6/users/088c903452cd40ecb0c7e08d4ae6ed8e/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.467922 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefab63-517d-4c7f-aa8d-c929a0bce454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d872307ee5443fc96be05582e55fbe6, user_id=088c903452cd40ecb0c7e08d4ae6ed8e, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:43.472038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefab63-517d-4c7f-aa8d-c929a0bce454 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:43.489638 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1425/2840] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:34:43 2022] PUT /identity/v3/projects/8d872307ee5443fc96be05582e55fbe6/users/088c903452cd40ecb0c7e08d4ae6ed8e/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:43.493766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66942c96-7e05-4462-b089-34a9101991dc admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:43.505470 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66942c96-7e05-4462-b089-34a9101991dc admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:43.564817 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c138e0-04f8-44fd-a126-6de656e28bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:43.565483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c138e0-04f8-44fd-a126-6de656e28bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.565765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c138e0-04f8-44fd-a126-6de656e28bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.566071 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c138e0-04f8-44fd-a126-6de656e28bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.566792 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c138e0-04f8-44fd-a126-6de656e28bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:43.568399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c138e0-04f8-44fd-a126-6de656e28bd8 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:43.578363 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1416/2841] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:34:43.582587 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefab63-517d-4c7f-aa8d-c929a0bce454 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:43.592936 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefab63-517d-4c7f-aa8d-c929a0bce454 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:43.597869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:43.598754 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.599036 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.599310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] PATH_INFO: `/v3/projects/8d872307ee5443fc96be05582e55fbe6/users/088c903452cd40ecb0c7e08d4ae6ed8e/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.601388 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d872307ee5443fc96be05582e55fbe6, user_id=088c903452cd40ecb0c7e08d4ae6ed8e, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:43.604090 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:43.614563 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1426/2842] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:34:43 2022] PUT /identity/v3/projects/8d872307ee5443fc96be05582e55fbe6/users/088c903452cd40ecb0c7e08d4ae6ed8e/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:43.625695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c36f00-e86b-40e8-9656-d492e8c77509 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.626019 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c36f00-e86b-40e8-9656-d492e8c77509 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.626299 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c36f00-e86b-40e8-9656-d492e8c77509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.653010 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-e2c36f00-e86b-40e8-9656-d492e8c77509 None None] MFA Rules not processed for user `088c903452cd40ecb0c7e08d4ae6ed8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:34:43.654296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-e2c36f00-e86b-40e8-9656-d492e8c77509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:43.703911 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:43.729567 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1417/2843] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:34:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:34:43.742894 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:43.745729 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:43.756775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:43.808448 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac434b3-7a50-4f6e-a7b3-8c2ded526920 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:43.813535 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d7049-a2ea-467e-a67d-73ed6797bd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:43.814212 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d7049-a2ea-467e-a67d-73ed6797bd22 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:43.814485 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d7049-a2ea-467e-a67d-73ed6797bd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:43.814757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d7049-a2ea-467e-a67d-73ed6797bd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:43.824772 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d7049-a2ea-467e-a67d-73ed6797bd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:43.826251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d7049-a2ea-467e-a67d-73ed6797bd22 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:43.835965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1427/2844] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:45.242237 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c36f00-e86b-40e8-9656-d492e8c77509 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:45.304874 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c36f00-e86b-40e8-9656-d492e8c77509 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:45.309748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:45.310655 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:45.310932 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:45.311191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] PATH_INFO: `/v3/users/474ec6e60b3d479c8fd1cb0252f5b431` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:45.312748 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474ec6e60b3d479c8fd1cb0252f5b431)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:45.314756 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:45.361695 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474ec6e60b3d479c8fd1cb0252f5b431'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.371259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474ec6e60b3d479c8fd1cb0252f5b431'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.382989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474ec6e60b3d479c8fd1cb0252f5b431'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.389819 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474ec6e60b3d479c8fd1cb0252f5b431'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.390465 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474ec6e60b3d479c8fd1cb0252f5b431'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.396283 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1418/2845] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:34:45 2022] DELETE /identity/v3/users/474ec6e60b3d479c8fd1cb0252f5b431 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:45.400855 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f982-9209-4478-8a48-2515c1c9d1de None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:45.401435 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f982-9209-4478-8a48-2515c1c9d1de None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:45.401559 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f982-9209-4478-8a48-2515c1c9d1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:45.419357 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bf06f982-9209-4478-8a48-2515c1c9d1de None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:34:45.420513 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bf06f982-9209-4478-8a48-2515c1c9d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:45.483671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1428/2846] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:34:45.493657 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:45.495296 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:45.558554 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b38716-b600-4bc7-aa52-1dd12a582f56 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:45.563766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486c005-76d4-40f4-8ffd-79655dc3b63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:45.564412 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c005-76d4-40f4-8ffd-79655dc3b63a service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:45.564693 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c005-76d4-40f4-8ffd-79655dc3b63a service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:45.564968 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c005-76d4-40f4-8ffd-79655dc3b63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:45.575113 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c005-76d4-40f4-8ffd-79655dc3b63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:45.576618 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c005-76d4-40f4-8ffd-79655dc3b63a service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:45.586571 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1419/2847] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:45.887343 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06f982-9209-4478-8a48-2515c1c9d1de None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:45.888901 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bf06f982-9209-4478-8a48-2515c1c9d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:45.905322 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06f982-9209-4478-8a48-2515c1c9d1de None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:45.910965 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:45.912020 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:45.912299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:45.912715 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] PATH_INFO: `/v3/projects/94d6759018f64f7aa81d7b3c89cce2bb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:45.914217 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d6759018f64f7aa81d7b3c89cce2bb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:45.916189 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:45.966787 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d6759018f64f7aa81d7b3c89cce2bb', 'request_id': 'req-68541550-3015-4189-8012-65f1a3653472'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.972207 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d6759018f64f7aa81d7b3c89cce2bb', 'request_id': 'req-68541550-3015-4189-8012-65f1a3653472'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.978362 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d6759018f64f7aa81d7b3c89cce2bb', 'request_id': 'req-68541550-3015-4189-8012-65f1a3653472'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.992027 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] The token cache is being invalidate because project 94d6759018f64f7aa81d7b3c89cce2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:34:45.992315 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.992948 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:45.994514 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1429/2848] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:34:45 2022] DELETE /identity/v3/projects/94d6759018f64f7aa81d7b3c89cce2bb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:45.999263 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486c005-76d4-40f4-8ffd-79655dc3b63a service neutron] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:46.009046 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486c005-76d4-40f4-8ffd-79655dc3b63a service neutron] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:46.014372 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:46.069426 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:46.070359 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:46.070640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:46.070912 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] PATH_INFO: `/v3/users/088c903452cd40ecb0c7e08d4ae6ed8e` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:46.072126 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=088c903452cd40ecb0c7e08d4ae6ed8e)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:46.074619 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:46.129324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '088c903452cd40ecb0c7e08d4ae6ed8e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.138362 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '088c903452cd40ecb0c7e08d4ae6ed8e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.151357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '088c903452cd40ecb0c7e08d4ae6ed8e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.158950 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '088c903452cd40ecb0c7e08d4ae6ed8e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.159625 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-18b85996-8600-43e4-b7ee-8dfa9b30cc36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '088c903452cd40ecb0c7e08d4ae6ed8e'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.165683 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1420/2849] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:34:45 2022] DELETE /identity/v3/users/088c903452cd40ecb0c7e08d4ae6ed8e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:46.460330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:46.461981 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:46.477933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68541550-3015-4189-8012-65f1a3653472 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:46.511071 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:46.540284 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:46.541200 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:46.541502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:46.541757 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] PATH_INFO: `/v3/projects/8d872307ee5443fc96be05582e55fbe6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:46.543508 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d872307ee5443fc96be05582e55fbe6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:46.545564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:46.593912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d872307ee5443fc96be05582e55fbe6', 'request_id': 'req-a4f550e7-094c-4c14-8cbc-c156af9d9548'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.600048 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d872307ee5443fc96be05582e55fbe6', 'request_id': 'req-a4f550e7-094c-4c14-8cbc-c156af9d9548'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.606805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d872307ee5443fc96be05582e55fbe6', 'request_id': 'req-a4f550e7-094c-4c14-8cbc-c156af9d9548'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.626204 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] The token cache is being invalidate because project 8d872307ee5443fc96be05582e55fbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:34:46.626459 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.627411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a4f550e7-094c-4c14-8cbc-c156af9d9548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:34:46.629743 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1430/2850] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:34:46 2022] DELETE /identity/v3/projects/8d872307ee5443fc96be05582e55fbe6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:46.636843 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533432-b3b7-4931-9d47-ae1279002fea None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:46.637377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533432-b3b7-4931-9d47-ae1279002fea None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:46.637377 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533432-b3b7-4931-9d47-ae1279002fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:46.655918 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-79533432-b3b7-4931-9d47-ae1279002fea None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:34:46.657118 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-79533432-b3b7-4931-9d47-ae1279002fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:46.719293 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1421/2851] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:34:46.727621 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eb99f-9f41-48cf-a1e6-2d05b663f343 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:46.727915 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eb99f-9f41-48cf-a1e6-2d05b663f343 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:46.728194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eb99f-9f41-48cf-a1e6-2d05b663f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:46.747564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b52eb99f-9f41-48cf-a1e6-2d05b663f343 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:34:46.748801 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b52eb99f-9f41-48cf-a1e6-2d05b663f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:46.757012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1431/2852] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:34:46.761535 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533432-b3b7-4931-9d47-ae1279002fea None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:46.771640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533432-b3b7-4931-9d47-ae1279002fea None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:46.778226 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:46.778869 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:46.779145 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:46.779413 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:46.780148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:34:46.780454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:46.782091 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:46.794539 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1422/2853] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:34:46.801558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52eb99f-9f41-48cf-a1e6-2d05b663f343 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:46.814555 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52eb99f-9f41-48cf-a1e6-2d05b663f343 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:46.820612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24b0b-78b8-4b4a-a8bc-923bb15264b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:46.821265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24b0b-78b8-4b4a-a8bc-923bb15264b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:46.821544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24b0b-78b8-4b4a-a8bc-923bb15264b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:46.821837 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24b0b-78b8-4b4a-a8bc-923bb15264b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:46.822556 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f24b0b-78b8-4b4a-a8bc-923bb15264b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:46.824611 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f24b0b-78b8-4b4a-a8bc-923bb15264b1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:46.853636 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1432/2854] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:34:46 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:34:46.858062 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:46.868545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8308c-15d6-4a5c-b213-f4e162cbd3ce admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:46.880456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:46.931098 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99e373-b458-47ba-9910-763cf0bbbd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:46.932070 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99e373-b458-47ba-9910-763cf0bbbd41 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:46.932497 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99e373-b458-47ba-9910-763cf0bbbd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:46.932863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99e373-b458-47ba-9910-763cf0bbbd41 admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:46.933765 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99e373-b458-47ba-9910-763cf0bbbd41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:46.935716 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99e373-b458-47ba-9910-763cf0bbbd41 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:46.959197 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1423/2855] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:34:46 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:34:46.964311 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24b0b-78b8-4b4a-a8bc-923bb15264b1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:46.976980 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24b0b-78b8-4b4a-a8bc-923bb15264b1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:46.982249 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a6fdc-a60a-4b6e-8e92-cddd355ea205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:46.982907 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6fdc-a60a-4b6e-8e92-cddd355ea205 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:46.983182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6fdc-a60a-4b6e-8e92-cddd355ea205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:46.983452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6fdc-a60a-4b6e-8e92-cddd355ea205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:46.984182 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a6fdc-a60a-4b6e-8e92-cddd355ea205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:46.985775 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a6fdc-a60a-4b6e-8e92-cddd355ea205 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:46.996703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1433/2856] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:34:47.001454 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99e373-b458-47ba-9910-763cf0bbbd41 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:47.016774 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99e373-b458-47ba-9910-763cf0bbbd41 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:47.024604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b100b-71ae-40d9-999f-ed55fc5328fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:47.025239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b100b-71ae-40d9-999f-ed55fc5328fb admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:47.025555 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b100b-71ae-40d9-999f-ed55fc5328fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:47.025831 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b100b-71ae-40d9-999f-ed55fc5328fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:47.027547 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b100b-71ae-40d9-999f-ed55fc5328fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:47.029213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b100b-71ae-40d9-999f-ed55fc5328fb admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:47.039946 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1424/2857] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:34:47.044522 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a6fdc-a60a-4b6e-8e92-cddd355ea205 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:47.054902 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a6fdc-a60a-4b6e-8e92-cddd355ea205 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:47.059998 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:47.060887 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:47.061166 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:47.061438 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] PATH_INFO: `/v3/projects/28216c74c1ac4336a7a35ac67e3c86e4/users/fb91e463a73b43ddae294b54afe573c7/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:47.077550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=28216c74c1ac4336a7a35ac67e3c86e4, user_id=fb91e463a73b43ddae294b54afe573c7, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:47.080269 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:47.095344 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1434/2858] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:34:47 2022] PUT /identity/v3/projects/28216c74c1ac4336a7a35ac67e3c86e4/users/fb91e463a73b43ddae294b54afe573c7/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:34:47.161729 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750562b-2a81-424a-98ad-a257161157fe None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:47.162196 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750562b-2a81-424a-98ad-a257161157fe None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:47.162679 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750562b-2a81-424a-98ad-a257161157fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:47.192024 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1750562b-2a81-424a-98ad-a257161157fe None None] MFA Rules not processed for user `fb91e463a73b43ddae294b54afe573c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:34:47.193248 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1750562b-2a81-424a-98ad-a257161157fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:47.274021 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1425/2859] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:34:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:34:47.288959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:34:47.292035 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:34:47.372258 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:47.391675 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43507bbb-d8a3-4045-a750-ef357b5663ed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:34:47.395624 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dd9aa-c2bc-4953-8540-eab30d353168 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c211cd37d7f49eaa916d332580135c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:34:47.396271 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd9aa-c2bc-4953-8540-eab30d353168 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:34:47.396549 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd9aa-c2bc-4953-8540-eab30d353168 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:34:47.396823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dd9aa-c2bc-4953-8540-eab30d353168 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:34:47.405921 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd9aa-c2bc-4953-8540-eab30d353168 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:34:47.407390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7dd9aa-c2bc-4953-8540-eab30d353168 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:34:47.416237 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1435/2860] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:34:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:34:57.270688 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=59,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:34:57.412310 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=8 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:09.382087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750562b-2a81-424a-98ad-a257161157fe None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:09.478575 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750562b-2a81-424a-98ad-a257161157fe None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:09.483763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:09.484646 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:09.484923 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:09.485192 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] PATH_INFO: `/v3/users/fb91e463a73b43ddae294b54afe573c7` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:09.486501 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb91e463a73b43ddae294b54afe573c7)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:09.488404 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:09.540842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb91e463a73b43ddae294b54afe573c7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:09.550602 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb91e463a73b43ddae294b54afe573c7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:09.563399 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb91e463a73b43ddae294b54afe573c7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:09.571000 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb91e463a73b43ddae294b54afe573c7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:09.571663 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb91e463a73b43ddae294b54afe573c7'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:09.581388 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1426/2861] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:35:09 2022] DELETE /identity/v3/users/fb91e463a73b43ddae294b54afe573c7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:09.586333 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b77762-d67b-4237-9e25-5c16a3131611 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:09.586831 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b77762-d67b-4237-9e25-5c16a3131611 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:09.586951 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b77762-d67b-4237-9e25-5c16a3131611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:09.614805 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b8b77762-d67b-4237-9e25-5c16a3131611 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:09.616220 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b8b77762-d67b-4237-9e25-5c16a3131611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:09.686194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1436/2862] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:09.696690 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:09.698218 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:09.763528 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:09.789161 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561c51-707a-408f-b127-06eeb4e9ae91 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:09.793829 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18db5b-1e40-40e2-b1de-63359347c1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:09.794506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18db5b-1e40-40e2-b1de-63359347c1bf service neutron] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:09.794792 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18db5b-1e40-40e2-b1de-63359347c1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:09.795068 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18db5b-1e40-40e2-b1de-63359347c1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:09.806209 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18db5b-1e40-40e2-b1de-63359347c1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:09.807666 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18db5b-1e40-40e2-b1de-63359347c1bf service neutron] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:09.818520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1427/2863] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:35:10.081548 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b77762-d67b-4237-9e25-5c16a3131611 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.083089 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b8b77762-d67b-4237-9e25-5c16a3131611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:10.095913 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b77762-d67b-4237-9e25-5c16a3131611 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.101313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.102225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.102505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.102776 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] PATH_INFO: `/v3/projects/28216c74c1ac4336a7a35ac67e3c86e4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.104933 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28216c74c1ac4336a7a35ac67e3c86e4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.106179 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.155397 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28216c74c1ac4336a7a35ac67e3c86e4', 'request_id': 'req-db9c7036-241c-46d7-8e16-47d7c7c06b53'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:10.160826 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28216c74c1ac4336a7a35ac67e3c86e4', 'request_id': 'req-db9c7036-241c-46d7-8e16-47d7c7c06b53'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:10.167002 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28216c74c1ac4336a7a35ac67e3c86e4', 'request_id': 'req-db9c7036-241c-46d7-8e16-47d7c7c06b53'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:10.182538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] The token cache is being invalidate because project 28216c74c1ac4336a7a35ac67e3c86e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:35:10.182828 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:10.183437 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-db9c7036-241c-46d7-8e16-47d7c7c06b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:10.184995 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1437/2864] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:35:10 2022] DELETE /identity/v3/projects/28216c74c1ac4336a7a35ac67e3c86e4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:10.190395 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47772bf-0d91-4c64-8c6c-16e5f99ed6b8 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.190668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47772bf-0d91-4c64-8c6c-16e5f99ed6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.190953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47772bf-0d91-4c64-8c6c-16e5f99ed6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.209389 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-d47772bf-0d91-4c64-8c6c-16e5f99ed6b8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:10.210638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-d47772bf-0d91-4c64-8c6c-16e5f99ed6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:10.281483 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1428/2865] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 17:35:10.292743 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f0f7-569d-445d-88e8-3e6fbfebdb8f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.293025 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f0f7-569d-445d-88e8-3e6fbfebdb8f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.293303 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f0f7-569d-445d-88e8-3e6fbfebdb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.313534 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b807f0f7-569d-445d-88e8-3e6fbfebdb8f None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:10.314785 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b807f0f7-569d-445d-88e8-3e6fbfebdb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:10.324223 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1438/2866] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:10.328580 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47772bf-0d91-4c64-8c6c-16e5f99ed6b8 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.339271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47772bf-0d91-4c64-8c6c-16e5f99ed6b8 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.345357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.346075 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.346360 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.346629 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] PATH_INFO: `/v3/domains` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.347366 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:35:10.347682 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.349520 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.362405 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1429/2867] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:35:10.367763 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807f0f7-569d-445d-88e8-3e6fbfebdb8f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.377472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807f0f7-569d-445d-88e8-3e6fbfebdb8f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.383596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400c2b-aacc-4688-9da5-160f81b7e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.384256 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400c2b-aacc-4688-9da5-160f81b7e2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.384536 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400c2b-aacc-4688-9da5-160f81b7e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.384807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400c2b-aacc-4688-9da5-160f81b7e2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.385505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400c2b-aacc-4688-9da5-160f81b7e2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.387453 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400c2b-aacc-4688-9da5-160f81b7e2e5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.418245 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1439/2868] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:35:10 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:35:10.422540 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.433456 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c844af-58a8-4e17-8e7f-1c91655a94af admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.497112 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef66c-a09e-4d19-b59a-c2e616278d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.497779 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef66c-a09e-4d19-b59a-c2e616278d7e admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.498087 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef66c-a09e-4d19-b59a-c2e616278d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.498357 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef66c-a09e-4d19-b59a-c2e616278d7e admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.499042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef66c-a09e-4d19-b59a-c2e616278d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.500976 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef66c-a09e-4d19-b59a-c2e616278d7e admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.521371 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1430/2869] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:35:10 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:35:10.525553 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400c2b-aacc-4688-9da5-160f81b7e2e5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.536932 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400c2b-aacc-4688-9da5-160f81b7e2e5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.542671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca61a-9a10-4bf6-a2b4-04a747cf7b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.543365 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca61a-9a10-4bf6-a2b4-04a747cf7b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.543642 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca61a-9a10-4bf6-a2b4-04a747cf7b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.543911 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca61a-9a10-4bf6-a2b4-04a747cf7b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.544640 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ca61a-9a10-4bf6-a2b4-04a747cf7b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.546273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ca61a-9a10-4bf6-a2b4-04a747cf7b79 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.557819 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1440/2870] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:35:10.562083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef66c-a09e-4d19-b59a-c2e616278d7e admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.572648 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef66c-a09e-4d19-b59a-c2e616278d7e admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.578083 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38956d-e01b-4b04-a20d-2f1aa314a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.578762 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38956d-e01b-4b04-a20d-2f1aa314a8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.579042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38956d-e01b-4b04-a20d-2f1aa314a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.579310 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38956d-e01b-4b04-a20d-2f1aa314a8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.580032 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38956d-e01b-4b04-a20d-2f1aa314a8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.581622 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38956d-e01b-4b04-a20d-2f1aa314a8d4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.591766 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1431/2871] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:35:10.596460 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca61a-9a10-4bf6-a2b4-04a747cf7b79 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.607857 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca61a-9a10-4bf6-a2b4-04a747cf7b79 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.613487 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca2495-a927-419f-ad71-ffb49f030cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.614440 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2495-a927-419f-ad71-ffb49f030cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.614737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2495-a927-419f-ad71-ffb49f030cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.615008 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2495-a927-419f-ad71-ffb49f030cab admin admin] PATH_INFO: `/v3/projects/75cc0d5e49ec4eb5bfa215554f8e8fbb/users/9842b6b6c05441c59a2ae2fffbb3d3a0/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.630160 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2495-a927-419f-ad71-ffb49f030cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cc0d5e49ec4eb5bfa215554f8e8fbb, user_id=9842b6b6c05441c59a2ae2fffbb3d3a0, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.634289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2495-a927-419f-ad71-ffb49f030cab admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.649146 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1441/2872] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:35:10 2022] PUT /identity/v3/projects/75cc0d5e49ec4eb5bfa215554f8e8fbb/users/9842b6b6c05441c59a2ae2fffbb3d3a0/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:10.659380 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406cb98-9d67-4738-bce5-78a2c00062ae None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.659668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406cb98-9d67-4738-bce5-78a2c00062ae None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.659940 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406cb98-9d67-4738-bce5-78a2c00062ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.688706 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-a406cb98-9d67-4738-bce5-78a2c00062ae None None] MFA Rules not processed for user `9842b6b6c05441c59a2ae2fffbb3d3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:10.689990 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-a406cb98-9d67-4738-bce5-78a2c00062ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:10.729442 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:10.763148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1432/2873] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:10.768077 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca2495-a927-419f-ad71-ffb49f030cab admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.781758 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:10.836056 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca2495-a927-419f-ad71-ffb49f030cab admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.841569 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502aeed1-f67d-45da-8c44-681c1b1e861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.842263 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aeed1-f67d-45da-8c44-681c1b1e861a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.842550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aeed1-f67d-45da-8c44-681c1b1e861a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.842858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aeed1-f67d-45da-8c44-681c1b1e861a admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.843551 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502aeed1-f67d-45da-8c44-681c1b1e861a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.845474 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502aeed1-f67d-45da-8c44-681c1b1e861a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.874194 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1442/2874] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:35:10 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:35:10.878707 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406cb98-9d67-4738-bce5-78a2c00062ae None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.889615 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406cb98-9d67-4738-bce5-78a2c00062ae None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.945928 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8776c-5c04-45db-8e35-0b9de63a54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.946499 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8776c-5c04-45db-8e35-0b9de63a54bf admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.946782 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8776c-5c04-45db-8e35-0b9de63a54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.947057 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8776c-5c04-45db-8e35-0b9de63a54bf admin admin] PATH_INFO: `/v3/users` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.947753 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8776c-5c04-45db-8e35-0b9de63a54bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.949678 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8776c-5c04-45db-8e35-0b9de63a54bf admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:10.977611 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1433/2875] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:35:10 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:35:10.978884 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502aeed1-f67d-45da-8c44-681c1b1e861a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:10.989401 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502aeed1-f67d-45da-8c44-681c1b1e861a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:10.994739 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3ac5f-916f-4df1-91be-3a5402bb711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:10.995396 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3ac5f-916f-4df1-91be-3a5402bb711e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:10.995677 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3ac5f-916f-4df1-91be-3a5402bb711e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:10.995957 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3ac5f-916f-4df1-91be-3a5402bb711e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:10.996692 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3ac5f-916f-4df1-91be-3a5402bb711e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:10.998335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3ac5f-916f-4df1-91be-3a5402bb711e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:11.009049 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1443/2876] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:35:11.013213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8776c-5c04-45db-8e35-0b9de63a54bf admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:11.023763 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8776c-5c04-45db-8e35-0b9de63a54bf admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:11.028824 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9a879-7c2e-43b4-b726-80ad05ced0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:11.029711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a879-7c2e-43b4-b726-80ad05ced0de admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:11.030148 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a879-7c2e-43b4-b726-80ad05ced0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:11.030429 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a879-7c2e-43b4-b726-80ad05ced0de admin admin] PATH_INFO: `/v3/projects/a5131fc77399446295c15329c6a44f2f/users/dfb7cc05a8aa442c8f2b3531767311a7/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:11.046522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9a879-7c2e-43b4-b726-80ad05ced0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5131fc77399446295c15329c6a44f2f, user_id=dfb7cc05a8aa442c8f2b3531767311a7, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:11.049189 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9a879-7c2e-43b4-b726-80ad05ced0de admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:11.065188 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1434/2877] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:35:11 2022] PUT /identity/v3/projects/a5131fc77399446295c15329c6a44f2f/users/dfb7cc05a8aa442c8f2b3531767311a7/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:11.069265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3ac5f-916f-4df1-91be-3a5402bb711e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:11.080081 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3ac5f-916f-4df1-91be-3a5402bb711e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:11.144701 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1455-0811-455d-8d5a-091945461a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:11.145635 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1455-0811-455d-8d5a-091945461a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:11.146039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1455-0811-455d-8d5a-091945461a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:11.146604 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1455-0811-455d-8d5a-091945461a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:11.147098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1455-0811-455d-8d5a-091945461a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:11.148704 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1455-0811-455d-8d5a-091945461a89 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:11.158802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1444/2878] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:35:11.163797 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9a879-7c2e-43b4-b726-80ad05ced0de admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:11.179660 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9a879-7c2e-43b4-b726-80ad05ced0de admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:11.188842 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:11.190181 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:11.190491 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:11.190791 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] PATH_INFO: `/v3/projects/a5131fc77399446295c15329c6a44f2f/users/dfb7cc05a8aa442c8f2b3531767311a7/roles/a4b74db35b2849f1b9b0ca6454c88831` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:11.193930 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5131fc77399446295c15329c6a44f2f, user_id=dfb7cc05a8aa442c8f2b3531767311a7, role_id=a4b74db35b2849f1b9b0ca6454c88831)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:11.196640 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:11.209379 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1435/2879] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:35:11 2022] PUT /identity/v3/projects/a5131fc77399446295c15329c6a44f2f/users/dfb7cc05a8aa442c8f2b3531767311a7/roles/a4b74db35b2849f1b9b0ca6454c88831 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:11.221620 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0df20-a420-41b9-912c-5293f7feb2f4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:11.222005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0df20-a420-41b9-912c-5293f7feb2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:11.222390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0df20-a420-41b9-912c-5293f7feb2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:11.250289 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c1e0df20-a420-41b9-912c-5293f7feb2f4 None None] MFA Rules not processed for user `dfb7cc05a8aa442c8f2b3531767311a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:11.251500 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c1e0df20-a420-41b9-912c-5293f7feb2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:11.322151 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1445/2880] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:11.336255 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:11.338339 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:11.404649 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce0fe5-aaa3-40a2-8f07-c9d2f0b0de7c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:11.408899 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295330a-ac74-4090-8594-f55cd96a9238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:11.409550 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295330a-ac74-4090-8594-f55cd96a9238 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:11.409822 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295330a-ac74-4090-8594-f55cd96a9238 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:11.410139 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295330a-ac74-4090-8594-f55cd96a9238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:11.456973 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:11.471103 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295330a-ac74-4090-8594-f55cd96a9238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:11.472546 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295330a-ac74-4090-8594-f55cd96a9238 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:11.481945 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1436/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:35:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:35:14.058985 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0df20-a420-41b9-912c-5293f7feb2f4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:14.069768 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:14.127243 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0df20-a420-41b9-912c-5293f7feb2f4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:14.132345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:14.133231 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:14.133504 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:14.133780 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] PATH_INFO: `/v3/users/9842b6b6c05441c59a2ae2fffbb3d3a0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:14.135018 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9842b6b6c05441c59a2ae2fffbb3d3a0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:14.136938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:14.189946 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9842b6b6c05441c59a2ae2fffbb3d3a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.190596 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9842b6b6c05441c59a2ae2fffbb3d3a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.200371 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9842b6b6c05441c59a2ae2fffbb3d3a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.207531 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9842b6b6c05441c59a2ae2fffbb3d3a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.219266 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9842b6b6c05441c59a2ae2fffbb3d3a0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.225519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1446/2882] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:35:14 2022] DELETE /identity/v3/users/9842b6b6c05441c59a2ae2fffbb3d3a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:14.230239 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983e89-1688-4b0b-96dd-c1d342657115 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:14.230772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983e89-1688-4b0b-96dd-c1d342657115 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:14.230772 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983e89-1688-4b0b-96dd-c1d342657115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:14.256365 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-55983e89-1688-4b0b-96dd-c1d342657115 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:14.257850 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-55983e89-1688-4b0b-96dd-c1d342657115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:14.321047 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1437/2883] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:14.330938 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:14.332533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:14.402240 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fdc7e-4abd-43bf-9a95-e2a42f603213 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:14.406848 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2789c-c68b-4260-8dca-3836544db9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:14.407503 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2789c-c68b-4260-8dca-3836544db9cc service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:14.407792 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2789c-c68b-4260-8dca-3836544db9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:14.408072 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2789c-c68b-4260-8dca-3836544db9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:14.418515 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2789c-c68b-4260-8dca-3836544db9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:14.419958 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2789c-c68b-4260-8dca-3836544db9cc service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:14.429727 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1447/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:35:14.713131 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55983e89-1688-4b0b-96dd-c1d342657115 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:14.714811 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-55983e89-1688-4b0b-96dd-c1d342657115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:14.727415 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55983e89-1688-4b0b-96dd-c1d342657115 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:14.732072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:14.732953 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:14.733231 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:14.733504 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] PATH_INFO: `/v3/projects/75cc0d5e49ec4eb5bfa215554f8e8fbb` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:14.734769 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cc0d5e49ec4eb5bfa215554f8e8fbb)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:14.736684 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:14.785871 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cc0d5e49ec4eb5bfa215554f8e8fbb', 'request_id': 'req-766d225a-b054-4649-81d8-ba5ff2735783'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.791805 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cc0d5e49ec4eb5bfa215554f8e8fbb', 'request_id': 'req-766d225a-b054-4649-81d8-ba5ff2735783'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.798246 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cc0d5e49ec4eb5bfa215554f8e8fbb', 'request_id': 'req-766d225a-b054-4649-81d8-ba5ff2735783'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.812938 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] The token cache is being invalidate because project 75cc0d5e49ec4eb5bfa215554f8e8fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:35:14.813224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.813942 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.815545 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1438/2885] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:35:14 2022] DELETE /identity/v3/projects/75cc0d5e49ec4eb5bfa215554f8e8fbb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:14.819723 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2789c-c68b-4260-8dca-3836544db9cc service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:14.830196 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2789c-c68b-4260-8dca-3836544db9cc service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:14.857550 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:14.892060 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:14.892937 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:14.893215 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:14.893486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] PATH_INFO: `/v3/users/dfb7cc05a8aa442c8f2b3531767311a7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:14.894725 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb7cc05a8aa442c8f2b3531767311a7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:14.896659 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:14.950520 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb7cc05a8aa442c8f2b3531767311a7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.951234 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb7cc05a8aa442c8f2b3531767311a7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.962225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb7cc05a8aa442c8f2b3531767311a7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.969199 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb7cc05a8aa442c8f2b3531767311a7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.981811 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-bfa9a767-bc87-4344-ae15-cf92195122f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb7cc05a8aa442c8f2b3531767311a7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:14.988441 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1448/2886] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:35:14 2022] DELETE /identity/v3/users/dfb7cc05a8aa442c8f2b3531767311a7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:15.273290 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:15.275005 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:15.289452 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d225a-b054-4649-81d8-ba5ff2735783 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:15.347835 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:15.348632 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.348888 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.349191 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] PATH_INFO: `/v3/projects/a5131fc77399446295c15329c6a44f2f` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.350431 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5131fc77399446295c15329c6a44f2f)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:15.352512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:15.362776 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:15.409331 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5131fc77399446295c15329c6a44f2f', 'request_id': 'req-50b7e382-c09b-4c88-8b77-a9d639b698b6'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:15.415272 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5131fc77399446295c15329c6a44f2f', 'request_id': 'req-50b7e382-c09b-4c88-8b77-a9d639b698b6'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:15.421271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5131fc77399446295c15329c6a44f2f', 'request_id': 'req-50b7e382-c09b-4c88-8b77-a9d639b698b6'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:15.434522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] The token cache is being invalidate because project a5131fc77399446295c15329c6a44f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:35:15.434814 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:15.435439 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-50b7e382-c09b-4c88-8b77-a9d639b698b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:15.437324 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1439/2887] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:35:15 2022] DELETE /identity/v3/projects/a5131fc77399446295c15329c6a44f2f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:15.442511 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1ec51-b7d7-47ef-b2bb-f4cade360376 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.443006 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1ec51-b7d7-47ef-b2bb-f4cade360376 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.443122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1ec51-b7d7-47ef-b2bb-f4cade360376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.462858 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4cb1ec51-b7d7-47ef-b2bb-f4cade360376 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:15.464098 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4cb1ec51-b7d7-47ef-b2bb-f4cade360376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:15.543472 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1449/2888] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:15.551872 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769479-6897-459a-968a-a51f161d0bdd None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.552166 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769479-6897-459a-968a-a51f161d0bdd None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.552450 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769479-6897-459a-968a-a51f161d0bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.572480 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-57769479-6897-459a-968a-a51f161d0bdd None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:15.573711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-57769479-6897-459a-968a-a51f161d0bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:15.583348 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1440/2889] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:15.589423 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1ec51-b7d7-47ef-b2bb-f4cade360376 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:15.602506 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1ec51-b7d7-47ef-b2bb-f4cade360376 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:15.611502 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:15.612345 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.612649 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.612996 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.614147 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:35:15.614533 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:15.617225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:15.631835 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1450/2890] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:35:15.637230 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769479-6897-459a-968a-a51f161d0bdd None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:15.652044 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769479-6897-459a-968a-a51f161d0bdd None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:15.661495 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4bc98-918d-4fa6-af11-12181c803658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:15.662563 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4bc98-918d-4fa6-af11-12181c803658 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.662898 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4bc98-918d-4fa6-af11-12181c803658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.663259 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4bc98-918d-4fa6-af11-12181c803658 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.664157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4bc98-918d-4fa6-af11-12181c803658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:15.666096 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4bc98-918d-4fa6-af11-12181c803658 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:15.699638 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1441/2891] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:35:15 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:35:15.704062 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:15.714452 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfaa48-2e0a-4ee2-8fd9-49f3cf972df9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:15.750005 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:15.777001 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67135ac9-0041-4ae9-93c0-f58d65c7bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:15.777671 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67135ac9-0041-4ae9-93c0-f58d65c7bf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.777988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67135ac9-0041-4ae9-93c0-f58d65c7bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.778273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67135ac9-0041-4ae9-93c0-f58d65c7bf6a admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.778967 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67135ac9-0041-4ae9-93c0-f58d65c7bf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:15.780890 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67135ac9-0041-4ae9-93c0-f58d65c7bf6a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:15.803313 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1451/2892] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:35:15 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:35:15.807668 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4bc98-918d-4fa6-af11-12181c803658 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:15.818937 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4bc98-918d-4fa6-af11-12181c803658 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:15.824170 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0f35c-3692-427d-9f84-322a8f55974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:15.824873 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0f35c-3692-427d-9f84-322a8f55974c admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.825152 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0f35c-3692-427d-9f84-322a8f55974c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.825425 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0f35c-3692-427d-9f84-322a8f55974c admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.826198 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0f35c-3692-427d-9f84-322a8f55974c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:15.827863 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0f35c-3692-427d-9f84-322a8f55974c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:15.838409 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1442/2893] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:35:15.842469 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67135ac9-0041-4ae9-93c0-f58d65c7bf6a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:15.853612 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67135ac9-0041-4ae9-93c0-f58d65c7bf6a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:15.859450 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e866-afc7-4aff-9815-8468d7d67d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:15.860106 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e866-afc7-4aff-9815-8468d7d67d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.860390 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e866-afc7-4aff-9815-8468d7d67d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.860663 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e866-afc7-4aff-9815-8468d7d67d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.861393 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e866-afc7-4aff-9815-8468d7d67d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:15.863038 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e866-afc7-4aff-9815-8468d7d67d25 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:15.874158 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1452/2894] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:35:15.879147 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0f35c-3692-427d-9f84-322a8f55974c admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:15.894184 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0f35c-3692-427d-9f84-322a8f55974c admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:15.900848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:15.901757 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.902063 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.902336 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] PATH_INFO: `/v3/projects/ab2cdfc822fd4a3f9571874ee81f934b/users/b31e4d4707e34048a03d088da6980eb8/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.920030 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2cdfc822fd4a3f9571874ee81f934b, user_id=b31e4d4707e34048a03d088da6980eb8, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:15.922726 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:15.942085 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1443/2895] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:35:15 2022] PUT /identity/v3/projects/ab2cdfc822fd4a3f9571874ee81f934b/users/b31e4d4707e34048a03d088da6980eb8/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:15.952558 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81662c3-35fe-4897-8337-fd2c99d3fdb1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:15.952869 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81662c3-35fe-4897-8337-fd2c99d3fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:15.953128 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81662c3-35fe-4897-8337-fd2c99d3fdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:15.982988 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f81662c3-35fe-4897-8337-fd2c99d3fdb1 None None] MFA Rules not processed for user `b31e4d4707e34048a03d088da6980eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:15.984230 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f81662c3-35fe-4897-8337-fd2c99d3fdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:16.050673 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1453/2896] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:16.061781 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:16.063749 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:16.124224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11957aa0-f833-4d2b-ad06-00200e53ada4 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:16.128160 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e7058-974c-48f5-b7d5-405d90cec01d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:16.128807 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7058-974c-48f5-b7d5-405d90cec01d service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:16.129089 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7058-974c-48f5-b7d5-405d90cec01d service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:16.129361 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7058-974c-48f5-b7d5-405d90cec01d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:16.138560 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e7058-974c-48f5-b7d5-405d90cec01d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:16.140016 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e7058-974c-48f5-b7d5-405d90cec01d service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:16.149254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1444/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:35:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:35:26.047519 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:26.145115 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:26.245695 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81662c3-35fe-4897-8337-fd2c99d3fdb1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:26.311039 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81662c3-35fe-4897-8337-fd2c99d3fdb1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:26.316840 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:26.317823 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:26.318122 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:26.318376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] PATH_INFO: `/v3/users/b31e4d4707e34048a03d088da6980eb8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:26.319584 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31e4d4707e34048a03d088da6980eb8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:26.326905 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:26.382585 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31e4d4707e34048a03d088da6980eb8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.383244 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31e4d4707e34048a03d088da6980eb8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.391616 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31e4d4707e34048a03d088da6980eb8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.398544 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31e4d4707e34048a03d088da6980eb8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.410341 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31e4d4707e34048a03d088da6980eb8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.416206 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1454/2898] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:35:26 2022] DELETE /identity/v3/users/b31e4d4707e34048a03d088da6980eb8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:26.421060 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1419-a3b3-4e8f-8605-19cb5a8685f6 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:26.421346 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1419-a3b3-4e8f-8605-19cb5a8685f6 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:26.421595 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1419-a3b3-4e8f-8605-19cb5a8685f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:26.441213 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-289a1419-a3b3-4e8f-8605-19cb5a8685f6 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:26.442466 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-289a1419-a3b3-4e8f-8605-19cb5a8685f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:26.507711 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1445/2899] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:26.518505 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:26.520910 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:26.583541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ad54f-66be-4acc-aefe-101ea1dbb77a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:26.588059 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fda88-ff2c-4bfb-b274-85d543880750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:26.588703 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fda88-ff2c-4bfb-b274-85d543880750 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:26.588989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fda88-ff2c-4bfb-b274-85d543880750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:26.589251 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fda88-ff2c-4bfb-b274-85d543880750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:26.599228 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fda88-ff2c-4bfb-b274-85d543880750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:26.600669 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fda88-ff2c-4bfb-b274-85d543880750 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:26.610912 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1455/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:35:26.888527 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a1419-a3b3-4e8f-8605-19cb5a8685f6 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:26.890228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-289a1419-a3b3-4e8f-8605-19cb5a8685f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:26.902821 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a1419-a3b3-4e8f-8605-19cb5a8685f6 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:26.907983 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:26.908875 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:26.909157 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:26.909444 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] PATH_INFO: `/v3/projects/ab2cdfc822fd4a3f9571874ee81f934b` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:26.910719 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2cdfc822fd4a3f9571874ee81f934b)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:26.912628 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:26.967228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2cdfc822fd4a3f9571874ee81f934b', 'request_id': 'req-2e94a081-0ef5-4033-b364-0af93e77194c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.973104 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2cdfc822fd4a3f9571874ee81f934b', 'request_id': 'req-2e94a081-0ef5-4033-b364-0af93e77194c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.979347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2cdfc822fd4a3f9571874ee81f934b', 'request_id': 'req-2e94a081-0ef5-4033-b364-0af93e77194c'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.994271 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] The token cache is being invalidate because project ab2cdfc822fd4a3f9571874ee81f934b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:35:26.994589 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.995205 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-2e94a081-0ef5-4033-b364-0af93e77194c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:26.997281 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1446/2901] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:35:26 2022] DELETE /identity/v3/projects/ab2cdfc822fd4a3f9571874ee81f934b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:27.002595 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a430-9321-4dd5-8c95-383b12ec84e0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.003029 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a430-9321-4dd5-8c95-383b12ec84e0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.003314 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403a430-9321-4dd5-8c95-383b12ec84e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.022114 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9403a430-9321-4dd5-8c95-383b12ec84e0 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:27.023330 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9403a430-9321-4dd5-8c95-383b12ec84e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:27.042070 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:27.087012 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1456/2902] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:27.094958 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410dbea-5874-4330-b8f4-0ebd2df99b30 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.095242 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410dbea-5874-4330-b8f4-0ebd2df99b30 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.095512 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410dbea-5874-4330-b8f4-0ebd2df99b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.115123 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-1410dbea-5874-4330-b8f4-0ebd2df99b30 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:27.116327 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-1410dbea-5874-4330-b8f4-0ebd2df99b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:27.128564 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1447/2903] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:27.135630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403a430-9321-4dd5-8c95-383b12ec84e0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:27.151486 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403a430-9321-4dd5-8c95-383b12ec84e0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:27.157718 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:27.158411 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.158694 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.158987 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.159730 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 17:35:27.160034 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:27.161666 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:27.173586 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1457/2904] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jun 23 17:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 17:35:27.178307 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410dbea-5874-4330-b8f4-0ebd2df99b30 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:27.188492 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410dbea-5874-4330-b8f4-0ebd2df99b30 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:27.194250 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492713b-438a-477f-97d2-3616ead79bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:27.194922 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492713b-438a-477f-97d2-3616ead79bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.195208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492713b-438a-477f-97d2-3616ead79bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.195484 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492713b-438a-477f-97d2-3616ead79bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.196185 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492713b-438a-477f-97d2-3616ead79bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:27.198146 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492713b-438a-477f-97d2-3616ead79bf9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:27.226092 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1448/2905] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jun 23 17:35:27 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:35:27.230335 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:27.240737 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e90a2-3278-4364-8d9a-ec118e610a91 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:27.298702 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b764-06c8-4f89-ab46-299f73eb4692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:27.299370 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b764-06c8-4f89-ab46-299f73eb4692 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.299653 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b764-06c8-4f89-ab46-299f73eb4692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.299929 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b764-06c8-4f89-ab46-299f73eb4692 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.300614 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b764-06c8-4f89-ab46-299f73eb4692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:27.302619 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b764-06c8-4f89-ab46-299f73eb4692 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:27.327883 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1458/2906] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jun 23 17:35:27 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 17:35:27.332211 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492713b-438a-477f-97d2-3616ead79bf9 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:27.342982 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492713b-438a-477f-97d2-3616ead79bf9 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:27.347848 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046eb6-f268-4994-98e4-899421fa9970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:27.348508 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046eb6-f268-4994-98e4-899421fa9970 admin admin] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.348787 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046eb6-f268-4994-98e4-899421fa9970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.349055 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046eb6-f268-4994-98e4-899421fa9970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.349784 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f046eb6-f268-4994-98e4-899421fa9970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:27.351385 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f046eb6-f268-4994-98e4-899421fa9970 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:27.361969 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1449/2907] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:35:27.365881 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b764-06c8-4f89-ab46-299f73eb4692 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:27.376422 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b764-06c8-4f89-ab46-299f73eb4692 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:27.381724 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33c397-7851-4bdc-9db7-71062c37a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:27.382412 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c397-7851-4bdc-9db7-71062c37a8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.382693 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c397-7851-4bdc-9db7-71062c37a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.382963 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33c397-7851-4bdc-9db7-71062c37a8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.383705 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c397-7851-4bdc-9db7-71062c37a8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:27.385299 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33c397-7851-4bdc-9db7-71062c37a8f7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:27.396045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1459/2908] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jun 23 17:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 17:35:27.400773 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046eb6-f268-4994-98e4-899421fa9970 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:27.412506 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046eb6-f268-4994-98e4-899421fa9970 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:27.417604 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:27.418642 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.418919 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.419338 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] PATH_INFO: `/v3/projects/326d49b0258c4e4797a490ec0b9d1423/users/2dad1e25611c41edbac86e13df1291f0/roles/49ef71b3a9cd4f78998c8e7924bc1fac` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.438058 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=326d49b0258c4e4797a490ec0b9d1423, user_id=2dad1e25611c41edbac86e13df1291f0, role_id=49ef71b3a9cd4f78998c8e7924bc1fac)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:27.441989 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:27.463673 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1450/2909] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jun 23 17:35:27 2022] PUT /identity/v3/projects/326d49b0258c4e4797a490ec0b9d1423/users/2dad1e25611c41edbac86e13df1291f0/roles/49ef71b3a9cd4f78998c8e7924bc1fac => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:27.474972 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f9a5-f758-403e-bfc7-bac4b109d860 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.475262 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f9a5-f758-403e-bfc7-bac4b109d860 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.475538 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f9a5-f758-403e-bfc7-bac4b109d860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.506564 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e564f9a5-f758-403e-bfc7-bac4b109d860 None None] MFA Rules not processed for user `2dad1e25611c41edbac86e13df1291f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:27.507802 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e564f9a5-f758-403e-bfc7-bac4b109d860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:27.574898 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1460/2910] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:27.586253 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:27.588175 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:27.614608 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:27.652522 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03fb0c-8576-4f4d-b786-e2f9fec155c9 admin admin] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:27.657072 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fcaaf-81cc-4dd7-92f3-201577b539a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c8b0c3534b84db68461b426a3f78773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:27.657725 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fcaaf-81cc-4dd7-92f3-201577b539a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:27.658042 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fcaaf-81cc-4dd7-92f3-201577b539a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:27.658333 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fcaaf-81cc-4dd7-92f3-201577b539a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:27.667407 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fcaaf-81cc-4dd7-92f3-201577b539a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:27.668999 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fcaaf-81cc-4dd7-92f3-201577b539a2 service cinder] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:27.677936 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1451/2911] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:35:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:35:37.571893 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:37.673916 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=17 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:48.197413 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f9a5-f758-403e-bfc7-bac4b109d860 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:48.261030 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f9a5-f758-403e-bfc7-bac4b109d860 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:48.266347 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:48.267247 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:48.267541 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:48.267807 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] PATH_INFO: `/v3/users/2dad1e25611c41edbac86e13df1291f0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:48.269123 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dad1e25611c41edbac86e13df1291f0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:48.271069 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:48.321273 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dad1e25611c41edbac86e13df1291f0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.321962 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dad1e25611c41edbac86e13df1291f0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.330789 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dad1e25611c41edbac86e13df1291f0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.338225 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dad1e25611c41edbac86e13df1291f0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.350323 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dad1e25611c41edbac86e13df1291f0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.356376 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1461/2912] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jun 23 17:35:48 2022] DELETE /identity/v3/users/2dad1e25611c41edbac86e13df1291f0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:48.361513 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e56b-f865-4d43-b98e-1c119f59e6f8 None None] REQUEST_METHOD: `POST` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:48.362078 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e56b-f865-4d43-b98e-1c119f59e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:48.362208 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7e56b-f865-4d43-b98e-1c119f59e6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:48.380004 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.auth.core [None req-60b7e56b-f865-4d43-b98e-1c119f59e6f8 None None] MFA Rules not processed for user `6aa38b5acec04d4fa14aadd10b58f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 17:35:48.381224 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-60b7e56b-f865-4d43-b98e-1c119f59e6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:48.444217 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1452/2913] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jun 23 17:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 17:35:48.454577 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:48.456064 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:48.517547 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e789e-a983-4131-bf7a-fa07de03d526 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:48.521748 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a92136d53514159a22faacb60ef0c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:48.522429 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:48.522717 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:48.522989 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:48.532467 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:48.533940 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:48.543797 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1462/2914] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:35:48.822845 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7e56b-f865-4d43-b98e-1c119f59e6f8 None None] Authenticating user token {{(pid=80414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:35:48.824355 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.fernet_utils [None req-60b7e56b-f865-4d43-b98e-1c119f59e6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:35:48.837111 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7e56b-f865-4d43-b98e-1c119f59e6f8 None None] Validating token access rules against request {{(pid=80414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:35:48.842347 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa38b5acec04d4fa14aadd10b58f34f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '817b32abe9534b1196adc7d371e17f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:35:48.843254 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:35:48.843536 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:35:48.843809 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] PATH_INFO: `/v3/projects/326d49b0258c4e4797a490ec0b9d1423` {{(pid=80414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:35:48.845093 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=326d49b0258c4e4797a490ec0b9d1423)` {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:35:48.847298 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] RBAC: Authorization granted {{(pid=80414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:35:48.898243 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326d49b0258c4e4797a490ec0b9d1423', 'request_id': 'req-4b845ec8-d53b-4f5c-9b6b-346ef510c913'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.903965 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326d49b0258c4e4797a490ec0b9d1423', 'request_id': 'req-4b845ec8-d53b-4f5c-9b6b-346ef510c913'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.910808 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326d49b0258c4e4797a490ec0b9d1423', 'request_id': 'req-4b845ec8-d53b-4f5c-9b6b-346ef510c913'} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.924343 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] The token cache is being invalidate because project 326d49b0258c4e4797a490ec0b9d1423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 17:35:48.924610 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.925228 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG keystone.notifications [None req-4b845ec8-d53b-4f5c-9b6b-346ef510c913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 17:35:48.926816 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: [pid: 80414|app: 0|req: 1453/2915] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jun 23 17:35:48 2022] DELETE /identity/v3/projects/326d49b0258c4e4797a490ec0b9d1423 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 17:35:58.539886 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:35:58.921316 dv-cinder-835384-10-iscsi devstack@keystone.service[80414]: DEBUG dbcounter [-] [80414] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 17:36:21.394373 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 17:36:21.396045 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:36:21.489959 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e994e-7b6a-41f0-abd8-a01a7abfb514 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 17:36:21.551080 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62595e-3c86-4af0-bedc-f1069002b504 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '067f71d863f7472eba2f5e9d04ae350e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ce35d28f42543bea1081516bc0e6e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 17:36:21.551736 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62595e-3c86-4af0-bedc-f1069002b504 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 17:36:21.552021 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62595e-3c86-4af0-bedc-f1069002b504 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 17:36:21.552297 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62595e-3c86-4af0-bedc-f1069002b504 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 17:36:21.554259 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ea62595e-3c86-4af0-bedc-f1069002b504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 17:36:21.566265 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62595e-3c86-4af0-bedc-f1069002b504 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 17:36:21.567838 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62595e-3c86-4af0-bedc-f1069002b504 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 17:36:21.577630 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1463/2916] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jun 23 17:36:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 17:36:31.573684 dv-cinder-835384-10-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=67 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}